REPORT  DOCUMENTATION  PAGE 


Fonn  Approved  OMB  No.  0704 


Public  reporting  burden  for  this  collection  of  infonnatioo  is  eslimnted  to  average  1  hour  per  response,  including  the  lime  for  reviewing  msuuction.  seaichin 
existing  data  sources,  gatfaering  and  maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  Ihi 
burden  estimate  or  any  other  aspect  of  this  collection  of  information,  inchiding  suggestions  for  reduemg  this  burden,  to  Washington  Headquarters  Services. 
Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington,  VA  22202-4302,  and  to  the  Office  of 
Management  and  Budget,  Paperwork  Reduction  Project  (0704-0188)  Washington  DC  20503. 


1.  AGENCY  USE  ONLY  2.  REPORT  DATE  3.  REPORT  TYPE  AND  DATES  COVERED 

hiank)  December  1993.  Master’s  Thesis 


4.  TITLE  AND  SUBTITLE  MULTIDIMENSIONAL  SCALING  OF 
USER  INFORMATION  SATISFACTION 


6.  AUTHOR(S)  Synihia  S.  Jones 


7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 
Naval  Postgraduate  School 
Monterey  CA  93943-5000 


9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADDRESS(ES) 


5.  FUNDING  NUMBERS 


8.  PERFORMING 
ORGANIZATION 
REPORT  NUMBER 


10.  SPONSORING/MONITORING 
AGENCY  REPORT  NUMBER 


12b.  DISTRIBUTION  CODE 
•A 


11.  SUPPLEMENTARY  NOTES  The  views  expressed  in  diis  thesis  arc  those  of  the  author  and  do  not 
reflect  die  official  policy  or  position  of  the  Department  of  Defense  or  the  U.S.  Government. 


t2a.  DISTRIBUTION/AVAILABILITY  STATEMENT 
Approved  for  public  release;  distribution  is  unlimited. 


13.  ABSTRACT  (maximum  200  words) 

The  objective  of  this  study  was  to  determine  if  multidimensional  scaling  reveals  more  about  user 
perception  of  satisfaction  widt  infonnation  systems  than  did  factor  analysis. 

Multidimensional  scaling  shed  a  different  light  on  information  satisfaction  data,  making  them  easier 
to  visualize  and  interpret.  While  the  differences  were  not  substantial  between  multidimensional  scaling 
and  factor  analysis,  we  concluded  diat  die  possibility  of  remarkably  new  insights  gained  through 
multidimensional  scaling  were  well  worth  die  small  marginal  cost  of  undertaking  the  analysis. 

Multidimensional  scaling  (MDS)  provides  an  information  technology  (IT)  manager  with  possible 
new  perspectives  in  the  analysis  of  user’s  satisfaction  widi  infonnation  and  with  information  systems. 
The  technique  probes  for  meanings  locked  in  user  satisfaction  data  that  are  not  accessible  by  other 
analytic  procedures.  IT  managers  should  be,  in  all  cases,  skeptical  of  contrived  hypothesis  testing  and 
factor  analyses  that  deal  widi  satisfaction  data  only  at  its  face  value.  MDS  gives  managers  a  tool  by 
which  they  can  identify  meanings  beyond  the  obvious.  Coupled  with  the  careful  and  effective  use  of  the 
semantic  differential  question  format,  MDS  is  a  powerful  means  to  escape  the  fatal  flaw  in  data 
gathered  by  survey  questionnaires:  socially  desirable  responses. 


14.  SUBJECT  TERMS  Multidimensional  Scaling,  User  Information  Satisfaction, 
Factor  Analyis,  Semantic  Differentials 

15.  NUMBER  OF 
PAGES  120 

16.  PRICE  CODE 

17.  SECURITY  CLASSIH- 
CATION  OF  REPORT 
Unclassified 

18.  SECURITY  CLASSIH- 
CATION  OF  THIS  PAGE 
Unclassified 

19.  SECURITY  CLASSIFI¬ 
CATION  OF 

ABSTRACT 

Unclassified 

20.  LIMITATION  OF 
ABSTRACT 

UL 

r 


Approved  for  public  release;  distribution  is  unlimited. 
Multidimensional  Scaling  of  User  Information  Satisfaction 


by 

Synthia  S.  Jones 
Lieutenant,  United  States  Navy 
B.S.,  University  of  Alabama,  1985 

Submitted  in  partial  fulfillment 
of  the  requirements  for  the  degree  of 

MASTER  OF  SCIENCE  IN  INFORMATION  TECHNOLOGY  MANAGEMENT 

from  the 

NAVAL  POSTGRADUATE  SCHOOL 
December  1993 


u 


1 


ABSTRACT 


The  objective  of  this  study  was  to  determine  if  multidimensional  scaling 
reveals  more  about  user  perception  of  satisfaction  with  information  systems  than 
did  factor  analysis. 

Multidimensional  scaling  shed  a  different  light  on  information  satisfaction 
data,  making  them  easier  to  visualize  and  interpret.  While  the  differences  were  not 
substantial  between  multidimensional  scaling  and  factor  analysis,  we  concluded 
that  the  possibility  of  remarkably  new  insights  gained  through  multidimensional 
scaling  were  well  worth  the  small  marginal  cost  of  undertaking  the  analysis. 

Multidimensional  scaling  (MDS)  provides  an  information  technology  (IT) 
manager  with  possible  new  perspectives  in  the  analysis  of  user's  satisfaction  with 
information  and  with  information  systems.  The  technique  probes  for  meanings 
locked  in  user  satisfaction  data  that  are  not  accessible  by  other  analytic 
procedures.  IT  managers  should  be,  in  all  cases,  skeptical  of  contrived  hypothesis 
testing  and  factor  analyses  that  deal  with  satisfaction  data  only  at  its  face  value. 
MDS  gives  managers  a  tool  by  which  they  can  identify  meanings  beyond  the 
obvious.  Coupled  with  the  careful  and  effective  use  of  the  semantic  differential 


question  format,  MDS  is  a  powerful  means  to  escape  the  fatal  flaw  in  data  gathered 
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I .  INTRODUCTION 


User  information  systems  have  become  a  catalyst  by  which 
the  Department  of  Defense  (DoD)  is  able  to  deal  with 
constantly  shrinking  budgets.  It  is  reduction  in  funds  which 
make  effective  use  of  information  system  of  such  importance. 

The  Composite  Health  Care  System  (CHCS)  is  only  one  of  the 
billion  dollar  information  systems  used  by  DoD  to  cope  with 
increased  requirements  for  processing  information. 

Management  of  infoinnation  systems  is  not  something  that 
can  be  done  on  an  Ad  Hoc  basis.  It  is  a  demanding 
responsibility  that  requires  strategic  planning  and  close 
scrutiny.  Whether  an  information  system  is  effective  depends 
upon  end-user's  perceptions.  DoD  must  have  a  means  by  which 
to  determine  if  dollars  spent  in  development  and  deployment  of 
major  information  systems  such  as  CHCS  are  seen  as  effective 
in  the  eyes  of  the  users  of  such  systems. 

A.  RESEARCH  OBJECTIVES 

The  primary  objective  of  this  research  was  to  determine 
if  multidimensional  scaling  tells  us  more  about  user 
perceptiion  of  satisfaction  with  information  systems  than  does 
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conventional  factor  analysis.  Management  is  eager  to  find  a 
tool  that  assesses  user  satisfaction  with  their  information 
systems . 
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II.  LITERATURE  REVIEW 


A.  IHTRODUCTION 

During  this  research,  I  reviewed  66  articles  in 
professional  journals  and  trade  periodicals  on  user 
satisfaction  of  information  systems.  Academics  have  done 
research  in  the  area  and  to  date  there  is  no  single  definition 
of  user  satisfaction.  In  this  study,  the  analysis  will  employ 
multidimensional  scaling  comparing  the  results  with  those  of 
a  previous  study  using  factor  analysis.  I  reviewed  literature 
in  three  areas:  user  satisfaction,  multidimensional  scaling 
and  factor  analysis. 

B.  USER  SATISFACTION/EFFECTIVENESS 

The  DoD  budget  for  automated  information  systems  (AIS)  in 
fiscal  year  1990  was  in  excess  of  $9  billion.  A  majority  of 
these  funds  were  used  to  modernize  or  simply  maintain  existing 
systems.  At  this  amount,  DoD  cannot  afford  to  have  AIS  which 
are  ineffective  and  unused.  It  is  for  this  reason  user 
satisfaction  is  of  great  importance. 

The  literature  classifies  user  satisfaction  into  various 
categories  to  include:  1)  value  of  information  systems 
economically,  2)  information  systems  effectiveness,  and  3) 
information  systems  usage.  Consequently,  studies  tend  to 
indicate  if  a  user  of  an  information  system  is  not  satisfied 
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with  the  system,  he/she  will  not  use  that  system  regardless  of 
the  cost  or  the  perceived  effectiveness. 

1.  Economic  Value  of  Information  Systems 

The  economic  value  of  information  systems  refers  in 
general  to  two  aspects  of  measuring  user  satisfaction:  1) 
value  analysis  and  2)  cost  benefit  analysis  (CBA)  .  The  value 
analysis  technique  is  geared  more  towards  the  effectiveness  of 
decision  making  systems.  It  is  used  by  managers  to  determine 
whether  the  user  is  willing  to  pay  more  to  keep  the  present 
decision  support  or  add  to  the  DSS  to  gain  additional  benefits 
(Cyrus,  1991) . 

A  more  commonly  used  measure  is  CBA.  This  measurement 
is  applied  to  AIS  when  there  is  an  investment  issue  to  be 
explored.  Because  acquisition  of  AIS  can  be  a  complex 
procedure  and  the  cost  can  often  exceed  a  billion  dollars,  CBA 
is  used  extensively.  The  essential  aspect  to  remember  is  that 
"cost  benefit  analysis  relies  on  the  fact  that  costs  and 
benefits  can  be  estimated  with  reasonable  accuracy"  (Cyrus, 
1991)  . 

2.  Information  Systems  Effectiveness  Measures 

Various  instruments  have  been  developed  to  measure  the 
effectiveness  of  user  information  systems  (UIS)  (Bailey  and 
Pearson,  1983;  Mick,  et  al.,  1980;  Montezcuni,  1988;  Schultz 
and  Slevin,  1975;  King  and  Epstein,  1982;  Chandler,  1982; 
Ives,  et  al.,  1983;  and  Baroudi  and  Orlikowski,  1988).  While 
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this  list  is  not  all  inclusive,  it  does  represent  a  sample  of 
the  research  that  has  been  done  in  the  field. 


Bailey  and  Pearson  (1983)  developed  a  semantic 
differential  instrument  which  they  claim,  has  been  validated. 
It  has  been  used  in  studies  to  determine  how  users  feel  about 
their  information  systems.  Their  instrument  was  a  39  item 
questionnaire  with  four  adjective  pairs  for  each  item.  This 
instrument  «ds  later  refined  by  Baroudi  and  Orlikowski  (1988) 
into  a  short -form  consisting  of  13  items  with  two  adjective 
pairs  per  item. 

The  Baroudi  and  Orlikowski  (1988)  short  form  is  of 
significance  because  it  is  the  form  that  was  used  by  Hurd 
(1991)  to  evaluate  the  CHCS  (Hurd,  1991) .  Lockhart  (1992) 
expanded  Hurd's  work  with  two  additional  naval  hospitals  that 
were  evaluating  the  CHCS.  The  results  from  these  evaluations 
will  be  discussed  later. 

3 .  System  Usage  of  Information  Systems 

System  usage  has  been  discussed  in  research  as  a 
behavioral  surrogate  by  users.  This  is  part  of  the  reason 
semantic  differential  scales  are  used  in  questionnaires  which 
seek  to  measure  UIS  effectiveness.  The  semantic  differential 
attempts  to  capture  the  attitude  of  users  (Osgood,  et  al., 
1957)  .  When  a  user  is  forced  to  use  an  information  system 
then  the  amiount  of  usage  cannot  be  a  factor  in  measuring 
system  effectiveness.  It  is  only  when  system  usage  is 
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voluntary  that  it  is  a  measure  of  information  system 
satisfaction.  Bailey  and  Pearson  (1983)  suggest  a  direct 
linkage  between  user  satisfaction  and  system  usage.  However, 
Baroudi  et  al.  (1986)  indicates  there  is  more  of  an  indirect 
relationship.  They  suggest  user  involvement  in  the 
development  or  modification  of  information  systems  has  a 
causal  relationship  upon  user  satisfaction  and  system  usage. 
"User  information  satisfaction  is  an  attitude  toward  the 
information  system  while  system  usage  is  a  behavior"  (Baroudi 
et  al . ,  1986) . 

C.  KOLTIDIMEtlSIOHAL  SCALING 

Multidimensional  Scaling  (MDS)  is  used  to  develop  a 
geometric  picture  of  the  locations  of  objects  relative  to  one 
another  in  meaning  space.  This  picture  shows  how  objects 
differ  or  are  similar.  It  also  reveals  any  hidden  meanings  of 
data  and  sometimes  makes  them  easier  to  understand  (Kruskal 
and  Wish,  1978)  .  Measuring  constructs  such  as  user 
satisfaction  is  an  excunple  of  something  difficult  to 
understand.  If  users'  perception  of  a  system  are  similar, 
then  items  will  fall  close  together  in  multidimensional  space. 
Items  which  are  perceived  to  be  dissimilar  will  be  farther 
apart  (Emory  and  Cooper,  1991) . 

When  using  MDS  the  data  can  of  two  types;  metric  or 
nonmetric.  Metric  data  mean  there  are  equal  intervals  between 
data  points  (e.g.,  -39  to  +39,  -3  to  +3).  For  example,  the 
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distance  between  data  values  of  3  and  5  is  the  same  as  between 


7  and  9.  Kruskal  and  Wish  (1978)  describe  metric  MDS  as  "a 
relationship  described  by  an  ordinary  formula  using  numerical 
or  metric  properties  of  the  proximities". 

Kruskal  and  Wish  (1978)  describe  nonmetric  MDS  as  "an  MDS 
in  which  an  increasing  function,  or  alternatively  a 
decreasing  function  is  aimed  for.  It  only  depends  on  the  rank 
order  of  the  proximities".  As  nonmetric  data  refer  to 
nominal  or  ordinal  data  (e.g.  very  high,  high,  neutral) , 
Kruskal  and  Wish's  description  agrees  with  those  of  Emory  and 
Cooper  (1991)  and  Green  and  Rao  (1972) . 

Determining  the  number  of  dimensions  to  use  with  MDS  is 
the  first  step  in  MDS  analysis.  The  greater  the  number  of 
dimensions  the  greater  the  accuracy  of  interpretation. 
Dimensionality  refers  to  the  niimber  of  coordinate  axes  upon 
which  graphical  representation  will  take  place.  This  is  akin 
to  the  nximber  of  factors  in  factor  analysis. 

In  addition  to  the  dimensionality  consideration,  other 
decisions  have  to  be  made  when  using  multidimensional  scaling. 
These  considerations  include;  interpretability,  ease  of  use, 
and  stability.  It  is  because  of  these  other  considerations 
that  MDS  is  nearly  always  used  as  a  descriptive  model  for 
representing  data  under  analysis  (Kruskal  and  Wish,  1978) . 

The  intent  of  MDS  is  to  describe  the  perception  of  the 
respondents  about  an  object  which  in  this  case  is  an 
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information  system.  The  perception  is  displayed  in  a  spatial 
form  which  can  be  of  three  types  called  attribute  space. 


•  Objective  Space:  an  object  can  be  positioned  in  terms  of 
its  flavor,  weight,  nutritional  value,  speed  of  processing 

•  Subjective  Space:  where  a  person's  perception  of  flavor, 
weight,  nutritional  value,  or  speed  of  processing  may  be 
positioned 

•  Ideal  Attributes :  all  objects  close  to  the  ideal  are 

interpreted  as  being  preferred  by  us  over  those  farther 
away  (Emory  &  Cooper,  1991) 


While  objective  space  and  subjective  space  may  not  coincide, 
they  may  provide  information  on  perceptual  disparity. 
Additionally,  subjective  space  may  vary  over  time  which  can 
provide  insight  on  trend  data. 

Multidimensional  scaling  has  various  conceptual  approaches 
to  scaling  of  similarities  data.  They  are  described  by  Green 
and  Rao  (1972) : 

•  Respondent  Task :  overall  similarities/dissimilarities 

responses  to  unspecified  criteria  versus  ratings  on 
specified  constructs  followed  by  computation  of  some 
derived  measure  of  similarity. 

•  Experimental  Emphasis:  scaling  of  aggregate  or  grouped 
data  versus  methods  that  retain  individual  differences. 

•  Scaling  Method!  metric  versus  nonmetric  scaling 
algorithms . 


In  a  matrix  form,  descriptors  take  on  combinations  allowing 
for  possibilities  of  interpreting  data  once  it  is  processed 
through  a  MDS  program. 
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D.  FACTOR  ANALYSIS 


Factor  analysis  looks  for  patterns  among  variables  to 
discover  if  an  underlying  combination  of  the  original 
variables  (factors)  can  summarize  the  original  set  (Emory  and 
Cooper,  1991) .  Long  (1983)  defines  factor  analysis  as  "a 
statistical  procedure  for  uncovering  a  (usually)  smaller 
number  of  latent  varicUDles  by  studying  the  covariation  among 
a  set  of  observed  varicdales."  As  with  MDS,  factor  analysis 
can  be  use  for  either  metric  or  nonmetric  data.  Factor 
analysis  is  used  mostly  for  exploratory  studies  because  of  the 
interpretational  nature  in  which  factor  loading  is  used.  This 
interpretational  nature  of  factor  analysis  causes  it  to  be 
subjective  (Emory  and  Cooper,  1991) .  For  this  reason,  there 
is  no  definitive  way  to  calculate  the  meanings  of  factors.  It 
is  thus  a  "what  you  see,  is  what  you  get"  type  of  technique. 

Factor  analysis  is  not  without  its  problems.  When 
attempting  to  interpret  the  results  of  factor  analysis  certain 
things  can  affect  the  process.  For  example,  if  the  sample  is 
too  small,  replicating  might  cause  different  results.  Another 
problem  might  be  if  more  factors  are  extracted,  the  results 
can  be  different  from  the  original  patterns.  There  is  thus 
the  need  for  more  careful  interpretation  when  using  factor 
analysis. 
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III.  RESEARCH  METHODOLOGY 


A.  IHTRODUCTION 

This  study  compares  the  analyses  of  two  studies  of  user 
information  satisfaction  (UIS)  using  factor  analysis  and 
multidimensional  scaling.  The  first  study  by  Hurd  (1991)  was 
to  identify  characteristics  of  UIS  for  users  of  the  Con5)osite 
Health  Care  System  (CHCS)  at  the  Naval  Hospital,  Charleston. 
The  second  study  by  Lockhart  (1992)  expanded  Hurd's  work  with 
data  on  two  additional  Naval  hospitals.  Lockhart  also 
evaluated  the  validity  of  the  survey  questionnaire  form  being 
used.  He  suggested  that  factor  analysis  was  an  appropriate 
method  for  determining  construct  validity. 

This  study  will  analyze  the  raw  data  from  the  Hurd  and 
Lockhart  studies  with  multidimensional  scaling  to  determine  if 
it  will  reveal  meanings  not  found  using  factor  analysis. 

B.  SAMPLE  AMD  DATA  COLLECTION 

1.  Background  of  the  Composite  Health  Care  System  (CHCS) 

CHCS  is  an  integrated  medical  information  system  the 
DoD  is  testing  for  in^lementation  in  medical  facilities.  CHCS 
is  designed  to  inprove  the  timeliness,  availability,  and 
quality  of  patient- care  data.  It  will  replace  manual  and 
older  automated  information  systems  now  supporting  DoD  medical 
treatment.  At  individual  hospitals,  it  will  integrate  the 
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functional  work  centers  of  inpatient  and  outpatient 
facilities,  patient  administration,  patient  appointment  and 
scheduling,  nursing,  laboratory,  pharmacy,  radiology  and 
clinical  dietetics.  CHCS  is  intended  to  provide  physicians 
with  immediate  access  to  patient  medical  records  (GAO-IMTEC- 
90-42,  1990). 

2.  Saxqple  and  Collection  of  Data 

The  three  naval  hospital  operations  test  and 
evaluation  (OT&E)  sites  (Charleston,  South  Carolina; 
Jacksonville,  Florida;  and  Camp  Lejeune,  North  Carolina)  were 
examined  in  this  study.  Hurd's  (1991)  data  from  the  Naval 
Hospital  Charleston,  and  Lockhart's  (1992)  data  from  the  Naval 
Hospitals  at  Jacksonville  and  Camp  Lejeune,  were  used  in  this 
study  in  lieu  of  re-saitpling.  The  three  sites  are 
approximately  medium- sized  naval  hospitals  ranging  from  170  to 
184  beds.  Outpatient  clinic  visits  range  from  360,000  to 
about  570,000  per  year  (GAO/IMrEC-90-42 ,  1990).  No  con5)lete 
inpatient  module  implementation  had  occurred  at  any  of  these 
hospitals  at  the  time  of  this  study.  Therefore,  the  nursing 
module  was  not  evaluated.  Additionally,  the  clinical 
dietetics  model  was  not  implemented.  The  modules  that  were 
implemented  were;  patient  administration  (PAD) ,  patient 
appointment  and  scheduling  (PAS) ,  pharmacy  (PHR) ,  laboratory 
(LAB) ,  and  radiology  (RAD)  .  The  PAD  module  was  still  being 
run  in  parallel  with  the  AQCESS  system,  and  did  not  have  the 
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cash  collections  component  (MSA)  on-line.  The  LAB  module  did 
not  have  the  blood  transfusion  service  component  on  line. 

Both  Hurd  (1991)  and  Lockhart  (1992)  used  a  short -form 
UIS  instnament  for  data  collection.  Hurd  used  the  short -form 
questionnaire  developed  by  Baroudi  and  Orlokowski  (1988) . 
Lockhart  modified  the  questionnaire,  specifically  questions  8 
and  10.  He  made  these  changes  to  clarify  the  questions  by 
using  Bailey  and  Pearson's  definitions  offered  by  Bailey  and 
Pearson  (1983)  (see  Appendix  A)  .  He  felt  that  there  could  be 
misunderstandings  interpretation  by  the  subjects. 

The  data  collection  set  employed  by  Hurd  and  Lockhart 
consisted  of  a  cover  letter,  the  short -form  UIS  instrument, 
and  an  addressed  return  envelope.  The  cover  letter  informed 
respondents  that  their  responses  would  be  held  in 
confidentiality . 

A  point  of  contact  at  Naval  Hospital  Charleston 
distributed  180  C[uestionnaire8.  The  CHCS  Project  officer  was 
sent  250  data  collection  sets  for  the  Naval  Hospital  Cair^ 
Lejeune  and  Naval  Hospital  Jacksonville.  General  guidance 
for  dissemination  at  each  facility  was  provided  to  ensure 
random  san^ling  of  all  CHCS  users  in  the  outpatient  areas 
(i.e.,  physicians,  clinics,  lcd>oratory,  radiology,  pharmacy, 
and  administrative  departments)  .  Upon  return  of  the  responses 
from  the  hospitals,  data  were  coded  and  categorized  into  three 
functional  groups:  physicians,  medical  support,  and 
administrative  support.  Lockhart  grouped  the  respondents 
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differently  from  the  Hurd  (1991)  study,  stating  his 
"groupings  better  represent  the  different  user  groups  in  terms 
of  the  function  provided  to  health  care,  and  therefore  use  of 
the  CHCS"  (Lockhart,  1992)  . 

Education,  sex,  use  of  other  computer  systems,  and  use 
of  other  health  care  information  system  demographic 
information  were  recorded  with  dichotomous  values  (i.e., 
male-1,  female-2,  no-0,  yes-1,  high  school  graduate-0,  etc.). 

All  responses  were  inputted  using  the  Ened>le  OA  an 
integrated  software  package.  This  package  allows  the 
researcher  to  build  a  datcibase  of  responses  and  ease  of  data 
retrieval  and  importation  of  this  data  into  a  spreadsheet 
format  for  statistical  analysis.  Each  of  the  questions 
(variables) ,  factors,  and  overall  satisfaction  scores  were 
computed  as  described  by  Baroudi  and  Orlikowski  (1988) . 

C.  MEASUREMENT  SCALES 

In  psychological  studies,  there  is  confusion  as  to  the 
legitimacy  of  using  particular  classes  of  mathematical 
procedures  (Galletta  and  Lederer,  1989;  Nunnally,  1978). 
Specifically,  the  use  of  parametric  statistical  procedure 
verses  nonparametric  procedure  with  measures  of  psychological 
attributes.  Parametric  statistical  procedures  have  more 
statistical  power  than  nonparametric  procedures.  However  they 
require,  at  a  minimum,  the  use  of  interval  data.  According  to 
Nimnally,  an  interval  scale 


13 


1)  the  rank -ordering  of  objects  is  known  with  respect  to 
an  attribute  and  2)  it  is  known  how  far  apart  the  objects 
are  from  another  with  respect  to  the  attribute,  but  3)  no 
information  is  availed>le  cdDout  the  absolute  magnitude  of 
the  attribute  for  any  object  (Nunnally,  1978) . 

Scaling  models  such  as  the  seven  interval  Likert -type  scaling 

model  used  with  the  short -form  UIS  instrument,  are  applied  by 

the  researcher  to  what  appears  to  be  ordered  categories  (  or 

ordinal  scales  )  to  the  subjects,  to  convert  the  data  into 

interval  scales.  Nunnally  (1978)  strongly  believes  that  it  is 

permissible  to  take  seriously  the  intervals  among  scores  in 

performing  analyses  of  attitude  such  as  that  used  with  the 

short -form  UIS  instrument.  It  is  beyond  the  scope  of  this 

paper  to  fully  explain  the  rationale  behind  these  arguments, 

and  it  is  recommended  that  readers  review  Nunnally  (1978) . 

In  this  study,  parametric  procedures  will  be  used, 

however,  nonparametric  procedures  will  be  used  in  those  cases 

where  testing  failed  to  support  the  underlying  assumptions  for 

parametric  procedures  (specially,  in  the  oneway  ANOVA 

procedure) .  All  testing  was  conducted  at  a  confidence  level 

of  95%  or  alpha  =  0.05. 

D.  VALIDATION  OF  THE  INSTRDMBllT 

1.  Homogeneity  of  the  Sample  Data  Sets 

Oneway  analysis -of -variance  (ANOVA)  using  a  PC  version 
of  MINITAB  statistical  program  and  macro  programs  (Schaefer 
and  Anderson,  1989)  provided  by  Zehna  (1990)  were  performed  on 
the  following  demographic  attributes:  education,  age,  gender. 
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length  of  time  (in  months)  of  CHCS  use,  use  of  other  computer 
systems,  and  use  of  other  health  care  information  systems  to 
ascertain  homogeneity  of  the  sample  data  sets.  ANOVA  methods 
have  been  developed  to  test  for  differences  between  the  means 
of  several  groups.  In  this  study,  ANOVA  procedures  were 
applied  to  the  three  subpopulations:  Charleston,  Camp 
Lejeune,  and  Jacksonville.  Where  significant  differences  in 
means  occurred,  the  Scheffe  multiple  comparison  testing  was 
conducted  a  posteriori.  Additionally,  a  posteriori  testing 
for  normality  and  homogeneity  of  variance  was  conducted. 

Normality  was  tested  using  MINITAB' s  option  for 
computing  and  storing  fitted  and  residual  values.  Applying 
the  NSCORE  function  to  compute  the  normal  scores  of  the 
residuals  and  then  confute  the  correlation  of  the  normal  score 
with  residuals  approximates  a  normal  distribution  if  the 
correlation  is  large  (i.e.,  the  closer  to  1.0  the  better) 
(Schaefer  and  Anderson,  1989).  The  Hartley's  Fmeuc  test  was 
used  for  homogeneity  of  varieuice. 

2.  Comaon  Factor  Analysis 

The  common  factor-analytic  model  is  different  from 
principal  components  analysis  in  that  it  makes  a  distinction 
between  common  and  specific  parts  of  variables.  In  principal 
components  analysis,  the  goal  is  to  construct  linear 
comtbinations  of  the  original  variables  that  account  for  a 
large  part  of  the  total  variation.  That  is  to  say,  the 
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unobserved  factors  (latent  variables)  are  expressed  as 
functions  of  the  observable  variables,  and  is  variance 
oriented,  and  without  an  error  term.  The  common  factor- 
analytic  model,  on  the  other  hand,  expresses  each  observcd)le 
variable  in  terms  of  unobservable  common  factor  and  a  unique 
factor,  and  is  covariance  oriented. 

The  common  variance  of  a  variable  is  called  the 
communality  of  the  variaUDle.  The  communality  of  a  variable  is 
the  portion  of  the  varicdsle's  total  variance  that  is  accounted 
for  by  the  common  factors.  With  the  principal  consonants 
analysis  there  is  no  error  term.  Conceptually,  the  cUbsence  of 
an  error  term  implies  that  the  observable  variad^les  are 
measured  without  error  and  that  the  unobservable  latent 
principal  component  is  a  perfect  linear  combination  of  its 
measures  or  are  formative  indicators  of  the  unobservable 
factor. 

Whereas,  common  factor  analysis  is  reflective  in  that 
the  indicators  subjective  to  measurement  error  are  a  function 
of  unobservables.  Instrument  construct  to  assess  attitude  are 
typically  viewed  as  underlying  factors  that  give  rise  to 
scxnething  that  is  observed,  and  therefore  their  indicators 
(i.e.,  the  observed  variables)  should  be  viewed  as  reflective, 
hence  the  use  of  the  common  factor- analytic  model.  Common 
factor -analytic  techniques  can  better  serve  the  functions  of 
searching  the  data  for  qualitative  and  quantitative 
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distinctions  and,  especially  testing  a  priori  hypotheses  and 
statistical  testing  criteria  (Dillon  and  Goldstein,  1984) . 

The  maximum- likelihood  common  factor  analysis  is 
preferred  due  to  its  ability  to  test  hypotheses  about  the 
number  of  common  factors.  There  are  two  different  data 
analysis  contexts:  exploratory  and  confirmatory. 
Exploratory  factor  analysis  is  simply  searching  for  a  common 
structure  underlying  the  data  without  having  any  theoretical 
hypothesis  in  mind.  Whereas,  confirmatory  factor  analysis 
there  exists  some  prior  theoretical  information  on  the  common 
structure  underlying  the  data  and  one  wishes  to  confirm  or 
negate  the  hypothesized  structure  (Dillon  and  Goldstein,  1984; 
SAS,  1989). 

The  rotation  process  of  factor  analysis  pattern  matrix 
provides  a  clearer  delineation  of  the  pattern  of 
relationships.  Rotation  options  allow  for  a  simple  factor 
solution  to  become  clearer.  There  are  two  methods  in  which 
the  factor  axes  can  be  rotated.  Orthogonal  rotation  preserves 
the  original  orientation  between  the  factors  so  that  they  are 
still  perpendicular  after  rotation.  Whereas,  oblique 
rotation,  the  factor  axes  can  be  rotated  independently. 
Varimax  orthogonal  rotation  spreads  variance  evenly  among 
factors  while  maintaining  the  original  orientation  between  the 
factors  so  that  they  are  still  perpendicular  after  rotation. 
The  procedure  seeks  to  rotate  factors  so  that  the  variation  of 
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the  squared  factor  loadings  for  a  given  factor  is  made  large 
(Dillon  and  Goldstein,  1984;  SAS,  1989;  Stewart,  1981) . 
a.  Exploratory  Factor  Analysis 

Initially,  exploratory  factor  analysis  was 
undertaken  using  SAS  maximum- likelihood  factor  analysis 
procedure  (SAS,  1989)  on  the  combined  data.  Multivariate 
normality  was  assxomed  in  conducting  the  exploratory  factor 
analysis.  Cattel's  scree  test  was  performed  for  determining 
the  approximate  number  of  factors  to  extract.  The  Cattell's 
scree  test  is  simply  a  visual  determination  of  the  point  where 
the  factors  curve  above  an  approximate  straight  line  made  from 
the  bottom  roots  (Stewart,  1991) . 

SAS  (1989)  has  the  capability  of  computing  the 
Kaiser-Meyer-Olkin  (MSA  option)  measure  of  sampling  adequacy. 
The  MSA  is  a  summary  of  the  extent  to  which  the  variables 
belong  together  and  are  thus  appropriate  for  factor  analysis 
(Stewart,  1981)  .  When  MSAs  are  greater  than  0.8,  they  can  be 
considered  good  (SAS,  1989;  Stewart,  1981)  .  Schwartz's 
Bayesian  Criterion  is  used  to  determine  the  best  number  of 
factors  to  be  extracted  using  the  naxirmim- likelihood  factor 
analysis  procedure.  The  number  of  factors  that  yields  the 
smallest  value  for  the  Schwartz's  Bayesian  Criterion  is 
considered  the  best  extraction  (SAS,  1989).  Schwartz's 
Bayesian  Criterion  according  to  the  SAS  user  guide  seems  to  be 
less  inclined  to  include  trivial  factors  than  eitner  the 
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Akaike's  Information  Criterion  or  the  chi-square  test  (SAS, 
1989). 

In  the  literature  there  have  been  problems  reported 
in  using  the  chi-square  test  due  to  its  susceptibility  to 
sample  size  (Mulaik,  et  al.,  1989;  Bentler  and  Bonnett,  1980; 
Byrne,  et  al.,  1989;  Marsh  and  Hocevar,  1985).  SAS  also 
provides  the  Tucker  and  Lewis'  Reliability  Coefficient 
automatically  for  maximxim- likelihood  factor  analysis 
procedure.  The  closer  the  Tucker  and  Lewis'  Reliability 
Coefficient  is  to  1.0  the  better  the  factor  solution  fit.  SAS 
also  automatically  computes  the  squared  canonical  correlation 
(which  is  the  same  as  squared  multiple  correlations)  for 
maiximum- likelihood  factor  analysis  procedure.  The  square 
multiple  correlation  (SMC)  for  each  variable  is  the  relative 
variance  in  that  variable  which  is  accounted  for  by  the 
overal.T  solution  jointly  (SAS,  1989;  Jdreskog  and  Sdrbom, 
1988)  . 

Basically,  the  SMC  represents  the  lower  bound  of 
reliability  that  each  variable  contributes  to  the  overall 
factor  structure.  The  maximum- likelihood  factor  analysis 
procedure  because  it  is  an  iterative  process  using  SMCs  for 
initial  estimates  (using  SAS)  is  susceptible  to  quasi-  or 
ultra-Heywood  cases.  It  is  beyond  the  scope  here  to  discuss 
these  anomalies,  however,  SAS  has  a  Heywood  option  which  sets 
to  1  any  communality  greater  than  1,  allowing  iterations  to 
proceed  until  convergence  criterion  is  met  (1989) .  The 
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Varimax  rotation  option  was  used  in  the  SAS  procedure  progrcim. 
Lastly,  the  data  was  standardized  using  the  SAS  procedure 
STANDARD  and  retested  using  the  maximum- likelihood  procedure 
as  above. 

Jb.  Confirmatory  Factor  Analysis 

After  obtaining  the  optimal  factor  structure 
solution  via  exploratory  factor  analysis,  confirmatory  factor 
analysis  was  conducted.  This  time  multivariate  normality  was 
not  assumed  and  the  observed  varied>les  were  analyzed  for 
goodness  of  fit  to  the  optimal  exploratory  factor  analysis 
model  using  Jdreskog  and  Sdrbom's  LISREL  7  (Linear  Structural 
Relations)  computer  program.  The  LISREL  model  can  be  viewed 
in  terms  of  a  confirmatory  factor  analytic  model  (Dillon  and 
Goldstein,  1984) .  Jdreskog  and  SSrbom  (1988)  in  their  LISREL 
7  manual  provide  testing  cases  for  non-normality  where  the 
observed  variaJsles  are  on  interval  scales  using  Weighted  Least 
Squares  analysis.  Using  Jdreskog  and  Sdrbom's  (1981-1989) 
PRELIS  program,  the  raw  data  is  converted  and  saved  as  a 
polychoric  correlation  matrix  and  an  asyn5)totic  convariance 
matrix  to  be  used  in  the  confirmatory  factory  analysis 
(Jdreskog  and  Sdrbom,  1988;  1981-1988) .  In  addition  to  the 
Total  Coefficient  of  Determination  (TCD) ,  Goodness  of  Fit 
Index  (6FI) ,  Adjusted  Goodness  of  Fit  Index  (AGFI) ,  and  Root 
Mean  Square  Residual  (RMR) ,  the  output  will  provide  the 
Standard  Errors  (SE) ,  and  t-values  (TV) . 
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LISREL's  t-values  or  critical  ratios  when  larger 
than  two  are  normally  judged  to  be  significantly  different 
from  zero,  and  therefore  indicating  a  true  pareuneter  for 
loading  in  that  factor  (Jdreskog  &  S6rbom,  1988)  .  The  TCD  is 
a  measure  of  how  well  the  variables  jointly  serve  as 
measurement  instruments  for  the  overall  factor  structure.  The 
closer  to  1.0  the  TOD,  GFI,  and  AGFI  are,  the  better  the  model 
fits  the  data.  The  RMR  and  SEs  should  all  be  very  small  to 
indicate  overall  good  fit  of  the  data.  There  is  some  debate 
about  the  use  of  the  GFI.  Mulaik  et  al.  (1989),  in  a  recent 
evaluation  recommends  the  use  of  GFI  when  one  has  samples  at 
least  200  in  size,  and  of  course  when  the  condition  for  that 
method  are  satisfied. 

3.  Reliability  (Intaznal  Consistency)  Testing 

Internal  consistency  was  tested  for  each  factor  using 
Cronbach's  Alpha  reliability  coefficient  option  in  SAS's 
correlation  procedure  (SAS,  1990).  Cronbach's  Alpha  is  based 
on  the  average  correlation  of  items  within  a  factor  (or  test)  . 
It  represents  the  correlation  between  this  factor  (or  test) 
and  all  other  possible  factors  (or  tests)  containing  the  same 
number  of  items,  which  could  be  constructed  from  a 
hypothetical  universe  of  items  that  measure  the  characteristic 
of  interest  (i.e.,  the  factor).  It  also  sets  an  upper  limit 
to  the  reliability  of  the  factor.  If  it  proves  to  be  very 
low,  either  the  factor  has  too  few  items  or  the  items  have 


very  little  in  common  (Nunnally,  1978) .  According  to  Nunnally 
(1978),  reliability  coefficients  of  .70  or  higher  will  suffice 
in  the  early  stages  of  research,  and  for  basic  research, 
efforts  to  increase  much  beyond  .80  is  often  a  waste  of  time 
and  funds. 

4.  Testing  for  Measurement  and  Structure  Invariance 

Having  conducted  common  factor  analysis  on  the  data  as 
a  whole,  the  next  verification  is  to  test  that  the  factor 
structure  and  loading  are  the  Scune  for  each  of  the  three 
subpopulations.  In  addition,  before  conducting  ANOVA  testing 
of  the  three  subpopulation  location's  for  evaluating  the 
difference  in  means,  it  is  important  to  confirm  that  the 
measurement  and  the  structure  of  the  instrument  designed  to 
ensure  attitudes  are  equivalent  across  the  subpopulations 
(Byrne  et  al.,  1989;  Marsh  and  Hocevar,  1985;  Drasgow  and 
Kanfer,  1985) . 

Jdreskog  and  S5rbom  (1988)  provide  a  methodology  to 
analyze  data  from  samples  simultaneously  using  their  LISREL 
models.  They  outline  a  series  of  tests  to  be  conducted  to 
confirm  measurement  and  structural  invariance.  The  first  test 
is  an  overall  test  of  the  equality  of  covariance  matrices 
across  the  three  sxibpopulations.  Failure  to  reject  the  null 
hypothesis  (i.e.,  covariance  matrices  are  equal)  is 
statistical  evidence  that  the  groups  can  be  treated  as  one. 
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The  next  series  of  testing  consisted  of  a  model  in 
which  certain  parameters  are  constrained  to  be  equal  across 
the  subpopulations  is  conpared  with  a  less  restrictive  model 
where  these  same  pareuneters  are  free  to  take  on  any  value 
(Byrne,  et  al.,  1989;  Jdreskog  and  Sorbom,  1988).  In  each  of 
these  tests,  at  least  one  of  the  scales  or  items  making  up 
each  of  the  factors  must  be  fixed  to  1.0.  The  highest  loading 
item  (from  previous  factor  analysis  above)  was  fixed  to  l.O. 
There  is  no  guidance  in  the  literature  as  to  which  item  to 
fix,  and  to  iteratively  fix  the  various  items  in  each  factor 
is  problematic.  The  choice  uses  that  item  which  strongly 
loads  into  its  respective  factor,  and  therefore  setting  it  to 
1.0  seemed  appropriate. 

The  second  test  examined  whether  there  are  four 
factors  in  all  three  subpopulations  with  a  factor  pattern  of: 
Factor  A  consists  of  questions  1,  6,  11;  Factor  B  consists  of 
questions  2,  12;  Factor  C  consists  of  questions  7,  8,  9,  10, 
13;  and  Factor  D  consists  of  questions  3,  4  and  5. 

The  third  test  was  for  invariance  in  factor  loadings 
(lambda  x)  across  the  subpopulations.  The  fourth  test  was  for 
invariance  in  the  error /uniqueness  (theta)  across  the 
subpopulations.  Lastly,  a  fith  test  examined  whether  the 
factor  variance  and  covariance  (phi)  are  invariant  across  the 
three  subpopulations. 

For  the  second  test,  subpopulations  2  and  3  are 
specified  to  have  the  Scune  pattern  and  the  same  starting 
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values  as  subpopulation  l  (IiX=PS  command  on  the  LISREL  7  model 
input  line) .  For  the  third  test,  subpopulations  2  and  3  are 
specified  to  be  invariant  for  factor  loading  from 
subpopulation  1  (LX-IN  command  on  the  LISREL  7  model  input 
line) .  The  fourth  test  additionally  constrained  the  theta 
matrices  to  be  invariant  {TD=IN  command  on  the  LISREL  7  model 
input  line) .  The  fifth  test  additionally  constrained  the  phi 
matrices  to  be  invariant  {PH«IN  command  on  the  LISREL  7  model 
input  line) .  The  LISREL  7  output  provides  the  GFI  and  RMR 
for  each  subpopulation.  The  chi-square  measure  provided  with 
the  last  subpopulation  was  the  measure  of  the  overall  fit  of 
the  three  subpopulations.  Alternative  indices  used  to  help 
evaluate  LISREL  models  in  multiple  Scui^le  analysis  where  the 
chi-square  measure  and  degrees  of  freedom  are  reported  as 
Slimmed  values  from  the  multi-sample  testing  (as  in  this 
testing)  are;  the  chi-square  to  the  degrees  of  freedom  ratio, 
and  the  chi-square  likelihood  ratio  tests.  The  chi- 
square/degrees  of  freedom  ratio  is  distributed  as  a  t- 
statistic  so  that  anything  greater  than  1.96  (in  this 
instances,  where  n=340,  and  alpha  -  0.05)  is  significant 
(Marsh  and  Hocevar,  1905) .  The  chi-square  likelihood  ratio 
(LR) ,  also  described  as  the  chi-square  difference  test,  is 
used  where  restricted  nested  models  are  used  as  in  this  case 
where  the  third,  fourth,  and  fifth  tests  are  restricted  nested 
models  of  the  second  test.  The  LR  test  is  calculated  by 
tcdcing  the  difference  in  the  chi-square  estimators  for  the 
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restricted  and  unrestricted  models  and  the  difference  in 
degrees  of  freedom  (df)  for  the  two  models  and  reporting  as  a 
chi-squared/df  ratio  (Byrne,  et  al.,  1989;  Marsh  and  Hocevar, 
1985;  Bollen,  1989). 

5.  Post  Survey  Interviews  (Convergent  Validity) 

Convergent  validity  is  the  extent  that  a  measure  is 
correlated  or  "agrees"  with  other  measures  of  the  same 
construct  (Ives,  et  al.,  1983).  Interviews  were  conducted 
with  randomly  selected  members  of  the  user  groups  at  the  Naval 
Hospitals  Camp  Lejeune,  and  Jacksonville.  The  interviews  were 
conducted  to  assess  users  overall  satisfaction  with  the  system 
for  comparison  with  the  questionnaire  results.  Additionally, 
the  interviews  were  used  to  gain  comments  about  the  system, 
and  the  short -form  UIS  instrument  used  in  this  study. 
Subjects  interviewed  were  assured  that  their  responses  would 
be  kept  confidential. 

E.  EVALUATION  OF  THE  INSTRUMENT'S  DATA 

1.  Testing  Differences  In  Means 

Oneway  analysis -of -variance  (ANOVA)  testing  was 
conducted  as  described  cdDOve  for  testing  homogeneity  of  scimple 
data  sets.  First,  Lockhart  (1992)  combined  the  three  hospital 
data  sets  to  test  the  difference  in  means  between  the  three 
user  groups  (physicians,  medical  support,  and  administrative 
support)  for  each  of  the  13  questions,  overall  score,  and 
factors.  Using  the  combined  data  set,  each  user  group  was 
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tested  for  differences  in  means  between  the  three  location 
sites  (i.e..  Charleston  vs  Caunp  Lejeune  vs  Jacksonville). 
Lastly,  each  hospital's  data  were  tested  for  differences  in 
means  between  the  three  user  groups. 

Where  significant  differences  in  means  occurred  (i.e. , 
P  value  less  than  0.05),  the  Scheffe  multiple  comparison 
testing  was  conducted  a  posteriori.  Additionally,  a 
posteriori  testing  for  normality  and  homogeneity  of  variance 
was  conducted.  Normality  was  tested  using  MINITAB' s  option 
for  computing  and  storing  fitted  and  residual  values  when 
performing  oneway  ANOVA  procedure.  Applying  the  NSCORE 
function  to  compute  the  normal  scores  of  the  residuals  and 
then  confuting  the  correlation  of  the  normal  score  with 
residuals  approximates  a  normal  distribution  if  the 
correlation  is  large  (i.e.,  the  closer  to  1.0  the  better) 
(Schaefer  and  Anderson,  1989).  The  Hartley's  Fmeoc  test  was 
used  for  homogeneity  of  variance. 

Nonpareunetric  Kruskal -Wallis  ANOVA  testing  of  seuR^le 
medians  was  conducted  in  those  situations  where  parametric 
ANOVA  testing  assunqptions  were  violated  (i.e.,  lack  of 
normality  and/or  homogeneity  of  variance)  .  Using  a  PC  version 
of  MINITAB  statistical  progreun  (Schaefer  and  Anderson,  1989) , 
the  Kruskal -Wallis  test  statistic  H  and  P  values  were 
calculated  and  adjusted  for  ties  in  responses.  Where 
significant  differences  in  medieuis  occurred,  the  MINITAB 
(Schaefer  and  Anderson,  1989)  nonparametric  Mann-Whitney  two- 
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sample  median  procedure  was  performed  in  pairwise  comparisons 
to  identify  individual  significant  differences. 

2 .  Time  of  Use  Correlation  Testing 

The  assvin5)tion  held  is  that  as  the  length  of  time  of 
use  of  the  system  increased,  the  user's  level  of  satisfaction 
would  increase.  The  CHCS  is  a  mandatory  use  system  as  opposed 
to  as  optional  use  system.  As  such,  medical  personnel  must 
use  the  CHCS  to  accomplish  their  work  (in  those  areas  where 
respective  CHCS  modules  have  been  installed) . 

Correlation  measures  the  degree  of  association  between 
two  varied>les.  The  range  of  correlation  strength  can  be  from 
-1.0  (perfect  negative  correlation)  to  +1.0  (perfect  positive 
correlation) ,  with  zero  meaning  no  correlation.  The  term 
"negative"  used  here  with  correlation  denotes  that  as  one 
variable  increases  the  other  variable  decreases.  The  term 
"positive"  used  with  correlation  denotes  that  as  one  varieUolc 
increases  the  other  variable  increases .  The  independent 
varied^le  used  in  this  study  was  time  of  use  of  the  CHCS  (in 
terms  of  months)  .  The  dependent  variable  to  test  against  were 
each  factor's  mean  scores.  'Die  Pearson's  Scuiple  correlation 
coefficient  (r)  was  obtained  by  Lockhart  (1992)  for  each 
comparison  using  MINITAB.  It  should  be  noted  that  rho  and  its 
estimate  r  are  both  symmetric  so  that  the  two  varicUales  to  be 
correlated  can  be  interchanged  without  changing  the  value.  It 
is  because  of  this  symsnetry  that  no  cause  and  effect  statement 
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may  be  made,  rather  just  the  strength  of  association  or 
relationship  between  the  two  variables  (Zehna,  1990) . 

The  Pearson's  sample  correlation  coefficient  was 
tested  for  significance  using  a  macro  program  provided  by 
Zehna  (1990)  for  MINITAB.  The  testing  of  the  sample 
correlation  coefficient  (r)  used  one-tailed  hypothesis  testing 
where  HI:  rho  >  0  if  r  was  positive  or  HI:  rho  <  0  if  r  was 
negative  to  obtain  the  appropriate  P  value.  A  P  value  of  less 
than  0.05  indicates  that  the  null  hypothesis  of  no  correlation 
may  be  rejected.  Correlations  were  performed  on  the  combined 
three  hospital  data. 

a.  Trend  AmtlyalB 

Hurd  (1991)  found  that  none  of  the  work  groups 
demonstrated  any  high  correlation  between  time  of  use  and  the 
level  of  satisfaction.  However,  he  used  six  month  time  series 
intervals  to  look  for  possible  trends  (negative  or  positive) 
between  the  time  of  use  of  the  CHCS  and  the  overall  UIS  summed 
score.  He  found  at  the  Naval  Hospital  Charleston,  that 
physicians  and  administrative  support  tended  to  exhibit  a 
positive  trend-line,  whereas,  the  ancillary  group  (which  is 
part  of  the  Medical  Support  group  in  this  study)  tended  to 
exhibit  a  negative  trend- line  for  overall  satisfaction. 

In  this  study,  the  trend  analysis  performed  by  Hurd 
(1991)  was  replicated.  Trend  analysis  of  the  mean  score  in 
six  month  intervals  for  each  factor  was  conducted.  The  number 
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of  individuals  involved  in  each  six  month  interval  and  the 
percentage  of  the  whole  were  tabulated  to  provide  clarity  as 
to  the  weighing  of  the  results.  The  trend  analysis  was 
performed  on  the  combined  three  hospital  data. 

P.  MOLTIDIMENSIONAL  SCALING  METHODS 

Multidimensional  scaling  (MDS)  is  an  attempt  to  further 
probe  respondents'  perceptions  in  the  data  collected  from  the 
three  naval  hospitals.  According  to  Schifmann  et  al.  (1981), 
MDS  is  a  mathematical  tool  which  shows  the  similarities  of 
varicUsles  in  a  spatial  map.  Perception  of  satisfaction  data 
collected  by  Hurd  (1991)  and  Lockhart  (1992)  was  prepared  to 
be  input  to  SPSS-X  (SPSS,  1988)  for  processing.  The  proximity 
matrices  generated  by  the  SPSS  command  PROXIMITIES  were  used 
as  input  to  ALSCAL.  The  SPSS  procedure  ALSCAL  was  used  to 
multidimensionally  scale  the  Hurd-Lockhart  data.  The  ALSCAL 
procedure  was  used  to  determine  differences  or  similarities  in 
the  13  satisfaction  variables  from  the  short  form 
questionnaire.  ALSCAL  produced  two-dimensional  nonmetric 
Euclidean  multidmensional  scaling  solutions  with  ordinal  data 
(SPSS,  1988) . 

1.  Determining  Proximities 

Proximities  are  data  sets  which  depict  the  amount  of 
perceived  difference  between  each  pair  of  a  set  of  stimuli 
(Schifmann  et  al.,  1981).  SPSS  procedure  PROXIMITIES 
determines  such  proximities.  A  data  list  from  the  13 
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satisfaction  variables  were  are  used  as  input.  Table  3.1 
shows  the  variable  titles  used.  Additionally,  we  specified 
that  the  variables  were  to  be  processed  as  proximities 
between  variables. 

TABLE  3.1 

PROXIMITY  VARIABLE  NAMES 


PLOT  SYMBOLS 

meanino 

SBMDIFF 

1  RELMID 

ReUlioiiihip  of  uicr  to  MID  MifT 

humony/diM 

good/bftd 

2  CHOSYS 

Procetting  of  rcqueiu  for  cbutges  to  tynan  ful/ikw 

timely/iiotiiiiely 

3  TRNO 

Traioiiig  provided  to  luen 

compl/iecoinpl 

high/low 

4  UNOBRSTD 

Uur’t  underModiBg  of  the  eyiUm 

nifT/iuuff 

camplete/mcorapletc 

5  PARTIC 

Uier’t  feeling  of  peitieipMioa 

poa/neg 

•uff/intufr 

<  MIOATT 

Altitude  of  die  MID  itaff 

coop/biUegerent 

poa/neg 

7  RELYINPO 

RelubiliQ'  of  output 

high/low 

luperior/infenor 

S  RELVINFO 

Releviace  of  output 

IMClul/uSClCSf 

leiv/inelv 

*  ACXHNFO 

Accuracy  of  output 

acc/inacc 

high/low 

A  PRECINFO 

Ptecuica  of  output 

high/law 

definile/uaceilaai 

B  MIDCOMM 

Uter'i  commuoicatioa  with  MID  Maff  harmony/diis 

produclive/uaprod 

C  TIMEDEV 

Time  required  for  •ytleina  devdopment  leaMoabk/uaieai 

arr/ynaff 

D  COMPLETE 

Corapleteneii  of  output 

iuff/insuff 

wln|uMc/Huidc(|iifll0 
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This  procedure  yielded  a  matrix  of  distances  used  as  input  to 
ALSCAL.  Matrices  for  each  hospital  and  combined  hospital  data 
are  shown  in  Appendix  C. 

2 .  Spatial  Mapping 

Proximities  computed  for  each  hospital  and  combined 
hospitals  were  stored  in  a  file  and  used  as  input  to  ALSCAL 
for  the  purpose  of  developing  a  spatial  map.  A  spatial  map 
depicts  the  relative  similarities  or  dissimilarities  among  the 
variodDles.  If  varicdales  are  closely  related  the  coordinate 
points  on  the  map  will  appear  close  together.  If  the 
varicibles  are  different,  the  points  will  appear  further  apart. 
This  map  is  the  objective  of  MDS.  From  it  one  can  interpret 
the  meaning  behind  the  distribution  of  the  points. 

ALSCAL  assumes  that  the  input  data  are  one  or  more 
square  symmetric  matrices  with  elements  at  the  ordinal  level 
of  measurement.  ALSCAL  will  produce  solutions  for  n 
dimensions.  However,  the  default  is  two  dimensions.  The 
default  settings  were  used  here.  The  output  consisted  of  two- 
dimensional  nonmetric  Euclidean  multidimensional  scaling 
solution.  Finally,  the  output  will  include  the  improvement  in 
Young's  S-STRESS  for  successive  iterations,  two  measures  of 
fit  for  each  input  matrix,  the  derived  configuration  and 
weights  when  appropriate  (SPSS,  1988) . 
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MDS  has  a  lower  chance  of  error  in  an  experiment 
(Schiffmann  et  al.,  1981).  It  does  not  require  previous 
knowledge  of  the  variables  being  used. 

3.  Dimensionality 

Dimensionality  refers  to  the  number  of  coordinate  axes 
used  to  locate  a  point  in  the  spatial  map.  Although  this 
concept  seems  simple,  it  can  be  ambiguous.  The  number  of 
interpretable  characteristics  for  a  spatial  map  can  often  be 
less  than  the  actual  dimensionality.  For  example,  we  may  only 
be  cdsle  to  interpret  two  dimensions  even  though  the  data  may 
indicate  a  three  or  four  dimensional  configuration. 

Determining  the  dimensionality  is  as  much  an  art  as  it 
is  a  statistical  procedure.  While  it  is  true  that  the  higher 
the  dimensionality,  the  more  accurate  the  representation  in 
the  spatial  map,  it  is  also  true  that  the  eUaility  to  interpret 
the  distribution  of  data  points  becomes  more  difficult  with  an 
increase  in  dimensions.  Therefore,  it  is  practicable  to  use 
two  and  seldom  more  than  three  dimensions. 

Part  of  interpreting  the  dimensions  is  based  on  the 
goodness  of  fit  of  the  data.  This  fit  is  depicted  by  a  stress 
measure.  Kruskal  and  Wish  (1978)  define  stress  as  the  "square 
root  of  a  normalized  residual  stun  of  squares".  The  higher  the 
stress  value  the  worst  the  fit  of  the  data.  We  were  able  to 
use  the  S- STRESS  value  which  is  given  as  an  output  for  the 
ALSCAL  procedure.  Most  MDS  algorithms  use  the  stress  measure 
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as  a  criterion  for  determining  the  best  fit  between  an 
original  input  matrix  and  the  estimated  distances  in  a  low¬ 
dimensional  solution  (McCain,  1990)  .  Kruskal  and  Wish  (1978) 
warn  that  a  numerical  value  may  indicate  good  fit  for  one 
measure  and  bad  fit  for  another.  The  ALSCAL  procedure  yields 
a  stress  value  and  squared  correlations  to  help  determine  the 
goodness  of  fit-  McCain  (1990),  explains  that  "stress  will 
decrease  and  correlations  will  increase  with  increasing  number 
or  dimensions".  The  ALSCAL  procedures  uses  the  Kruskal  Stress 
Formula  1  as  its  algorithm  (SPSS,  1988)  .  In  general  the 
stress  value  (STRESS)  and  the  corresponding  squared 
correlation  coefficient  (RSQ)  shows  the  fit  of  the  data.  A 
low  STRESS  (between  0  and  1)  and  a  high  RSQ  (between  0  and  1) 
depict  a  good  fit  between  the  data  and  the  solution. 
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XV.  DESCRIPTIVE  FINDINGS  (FACTOR  ANALYSIS) 


A.  INTRODUCTION 

The  findings  described  in  the  section  below  reflect  those 
from  research  done  by  Lockhart  (1992)  and  Hurd  (1991) .  These 
findings  are  based  on  the  statistical  methods  of  factor 
analysis  of  data  collected  from  the  Naval  Hospital  at 
Charleston,  Can^  Lejeune  and  Jacksonville.  Once  these 
findings  have  been  described,  the  findings  resulting  from 
multidimensional  scaling  will  be  described  in  Chapter  V. 

B.  DEMOGRAPHIC  FINDINGS  BY  LOCATION  AND  AS  A  GROUP  (FACTOR 

ANALYSIS) 

Of  the  three  Naval  hospitals  surveyed  by  Hurd  (1991)  and 
Lockhart  (1992),  101  used>le  questionnaires  were  obtained  from 
Naval  Hospital  Charleston,  121  from  Naval  Hospital  Camp 
Lejeune  and  118  from  the  Naval  Hospital  Jacksonville.  The 
response  rates  for  the  Naval  Hospitals  Charleston,  Cairp 
Lejeune  and  Jacksonville  were  56%,  48%  euid  47%,  respectively. 
Appendix  B  contains  a  summary  of  the  demographics  by  location 
and  as  a  group  (the  three  hospitals  combined) . 

1.  Age 

Hurd's  (1991)  data  revealed  an  average  age  of 
respondents  from  the  Naval  Hospital  Charleston  to  be  32 
years,  with  a  range  in  years  from  19  to  56.  Lockhart's  (1992) 
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data  revealed  the  average  age  of  respondents  from  the  Naval 
Hospital  Camp  Lejeune  was  33  years,  with  a  range  in  years  from 

18  to  61.  The  average  age  of  respondents  from  the  Naval 
Hospital  Jacksonville  was  32  years,  with  a  range  in  years  from 

19  to  56.  The  combined  group  had  an  average  age  of  32  years 
with  a  range  in  years  from  18  to  61  (Lockhart,  1992) . 

2 .  Gender 

The  gender  of  the  respondents  from  the  Naval  Hospital 
Charleston  were  57  (56%)  male  and  44  (44%)  female.  The  gender 
of  the  respondents  from  the  Naval  Hospital  Camp  Lejeune  were 
73  (60%)  male  and  48  (40%)  female.  The  gender  of  the 

respondents  from  the  Naval  Hospital  Jacksonville  were  83  (70%) 
male  and  35  (30%)  female.  The  gender  split  in  the  combined 
group  of  respondents  were  213  (63%)  male  and  127  (37%)  female 
(Lockhart,  1992)  . 

3 .  Hospital  Dapartments 

Only  outpatient  departments  were  sampled.  Work  areas 
reported  were  in  one  of  the  following  department  types; 
clinic,  administration,  leOsoratory,  pharmacy,  or  radiology. 
Figure  4.1  depicts  the  individual  and  combined  hospital 
department  types  and  percentages. 

4 .  Job  Dascriptions 

Job  descriptions  reported  were  categorized  into  one  of 
the  following  types; 
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DEPARTMENT  WORK  CENTERS 


Figure  4.1.  Department  Work  Centers 


•  Physician  -  a  Medical  Corps  Officer  or  civil iem 
equivalent . 

•  Nurse  -  a  Nurse  Corps  Officer  or  civilian  equivalent. 

•  Health  Professional  -  a  Medical  Service  Corps  Officer 
(Allied  Science)  or  civilicui  equivalent. 

•  Administrator  -  a  Medical  Service  Corps  Officer  (Health 
Care  Administration)  or  civilian  equivalent. 

•  Technician  -  a  Hospital  Corpsman  with  a  medical  technician 
rating  or  civilian  equivalent. 

•  Corpsman  -  a  Hospital  Corpsman  without  a  technical  rating. 

•  Clerical  -  a  person  performing  secretarial  or  clerical 
functions . 


Figure  4.2  depicts  the  individual  and  combined 
hospital  job  description  types  and  percentages. 


JOB  DESCRIPTIONS 
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Figure  4.2.  Job  Description 


5.  Functional  User  Groups 

Respondents  were  categorized  into  three  functional 
work  groups  based  on  their  work  department  auid  job  description 
types:  Physicians,  Medical  Support,  and  Administrative 
Support.  The  PhysicicUi  group  is  self  explanatory.  The 
Medical  Support  group  consisted  of:  nurses,  health 
professionals,  technicians,  and  corpsman  not  working  in  an 
administrative  department.  The  Administrative  Support  group 
consisted  of:  all  administrators,  and  clerical  persons 
regardless  of  department  assigned  to,  and  all  other  persons 
regardless  of  profession  assigned  to  an  administrative 
department.  Figure  4.3  depicts  the  individual  and  combined 
hospital  user  group  types  and  percentages. 
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USER  GROUPS 

(defined  by  member's  York  Center  and  Job  Description) 


IS  Physicians 


^  Ucdical  Support 


B  Administralirc  Support 


Figure  4.3.  User  Groups 


6.  Level  of  Education 

Looking  at  the  combined  hospital  data,  Figure  4.4, 
almost  90%  of  the  respondents  have  some  college  or  higher 
educational  experience.  The  median  education  level  of  the 
respondents  from  the  Naval  Hospital  Charleston  and  from  the 
Naval  Hospital  Camp  Lejexine  was  "some  college."  The  medicin 
education  level  of  the  respondents  from  the  Naval  Hospital 
Jacksonville  was  "bachelor  degree. "  The  median  education 
level  of  the  combined  group  was  "some  college."  Figure  4.4 
depicts  the  individual  etnd  combined  hospital  level  of 
education  emd  percentages. 
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EDUCATION  LEVEL 


Figure  4.4.  Educational  Level 


7.  Computer  Use 

Con^uter  use  is  a  task  for  this  group  of  participants . 
80%  of  all  the  participants  have  used  other  computer  systems. 
Of  these  users,  nearly  three  quarters  (74%)  have  used  other 
health  care  information  systems.  When  comparing  all 
respondents,  59%  have  used  other  health  care  information 
systems  (HCIS) .  The  respondents  from  the  Naval  Hospital 
Charleston  reported  a  80%  use  of  other  computer  systems;  of 
those  users,  71%  have  used  a  HCIS  and  of  all  respondents,  58% 
have  used  a  HCIS.  The  respondents  from  the  Naval  Hospital 
Can^  Lejeune  reported  a  76%  use  of  other  computer  systems;  of 
those  users,  68%  have  used  a  HCIS  and  of  all  respondents,  52% 
have  use  a  HCIS.  The  respondents  from  the  Naval  Hospital 
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Jacksonville  reported  a  86%  use  of  other  ccw^uter  systems;  of 
those  users,  76%  have  used  a  HCIS  and  of  all  respondents,  66% 
have  used  a  HCIS. 

8.  Length  of  Time  of  CECS  Use 

Of  all  respondents,  the  average  length  of  time  in 
months  of  use  of  the  CHCS  was  12.3  months.  The  overall  time 
of  use  ranged  from  one  month  to  36  months.  The  respondents 
from  the  Naval  Hospital  Charleston  reported  an  average  time  of 
use  of  8.6  months,  with  a  range  of  one  to  19  months.  The 
respondents  from  the  Naval  Hospital  Ceunp  Lejeune  reported  an 
average  time  of  use  of  12.5  months,  with  a  remge  of  one  to  36 
months.  The  respondents  from  the  Naval  Hospital  Jacksonville 
reported  an  average  time  of  use  of  15.3  months,  with  a  range 
of  one  to  32  months. 

C.  VALIDATION  OF  THE  INSTRDMBNT 

1.  Homogeneity  of  the  Saa^le  Data  Sets 

One  way  ANOVA  results  are  presented  in  Table  4.1a. 
Significant  differences  in  means  are  indicated  by  underlining. 
Significemt  differences  in  subpopulation  means  were  noted  in 
the  education  and  the  tdLme  of  use  of  CHCS  user  attributes. 
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TABLE  4.1A 

USER  ATTRIBUTES  ANOVA  TESTING 


ATTRIBUTE 

F value 

p value 

NSCORES 

HARTLEY 

CORRELATION 

FMAX(l) 

AOE 

0.16 

0.852 

0.98 

1.59 

GENDER 

2.48 

0.086 

0.88 

1.18 

COMPUTER  SYSTEM  EXPERIENCE 

2.18 

0.115 

0.81 

1.55 

HOSPITAL  INFORMATION  SYSTEM  EXPERIENCE 

2.45 

0.088 

0.89 

1.11 

r'JJUCATION 

4M 

0.93 

1.17 

Note: 

(1)  FiDaXo.,B,  appraxiaule  cfttkal  value  =  1.803,  a(pha  •  0.05 


The  Scheffe  interval  comparison  testing  for  the 
education  attribute  is  presented  in  TaQjle  4.1b.  Education  was 
tested  and  found  to  have  no  significant  correlation  with  the 
overall  satisfaction,  as  well  as  with  each  of  the  four  factors 
found  when  factor  analysis  was  performed.  Time  of  use  of  the 
CHCS  system  is  discussed  later  in  this  paper. 


TABLE  4. IB 

SCHEFFE  MULTIPLE  COMPARISON  TESTING  OF  EDUCATION  ATTRIBUTE 


STTE  LOCATION  COMPARISONS 

USER  ATTRIBUTE 

CHARLESTm/ 

CHARLESTON/ 

CAMPLEJEUNE/ 

CAMPLEJEUNE 

JACKSONVILLE 

JACKSONVILLE 

EDUCATION 

NS(1) 

NS(1) 

S(2) 

NOTES: 

(1)  NS  >  noDiigiiifieaat;  no  diflaence  between  die 

(2)  S  =  HiffiijMirf.  y^rtTurrr,  lli« 


2.  Eacploratory  Factor  Analysis 

The  combined  data  set  (ns340)  was  used  to  perform  the 
exploratory  factor  analysis  procedure.  The  Cattell  Scree  Test 
suggested  a  maximum  of  five  factors  may  possibly  exist.  The 
SAS  maximum  likelihood  factor  analysis  procedure  was  written 
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to  sequentially  perform  a  one-factor  solution  through  a  five- 
factor  solution.  Kaiser's  Measure  of  Sampling  Adequacy  (MSA) 
had  a  value  of  0.89  indicating  a  good  fit  of  the  data  for 
factor  analysis.  The  maocimum  likelihood  factor  analysis 
procedure  in  SAS  uses  squared  multiple  correlations  (SMC)  as 
its  initial  starting  estimate.  The  SMC  is  the  lower  bound  for 
the  reliability  of  each  variable.  The  SAS  squared  canonical 
correlations  (SCO  reported  for  each  factor  is  the  lower  bound 
of  relicibility  for  that  factor  from  the  varicd>les  that  make  up 
that  factor  (SAS,  1989) .  The  one -factor  solution  made  up  of 
all  13  questions  had  a  SCC  value  of  0.90. 

Schwartz's  Bayesicin  Criterion  (SBC)  value  kept 
decreasing  for  the  two- factor  and  the  three- factor  solutions. 
This  indicated  that  a  greater  than  three- factor  solution  was 
optimal.  The  three- factor  solution  had  a  SBC  of  219  and  a 
Tucker  auad  Lewis's  Relicd)ility  Coefficient  of  0.91.  At  the 
four- factor  solution,  the  SBC  reached  its  lowest  value  of  211, 
and  rose  to  the  value  of  217  at  the  five- factor  solution. 
TeQ)le  4.2  shows  the  optimal  four  factor  solution.  Tucker  euad 
Lewis'  Relied>ility  Coefficient  was  0.95  for  the  four- factor 
solution. 

Factor  A  is  made  up  of  questions  1,  6,  and  11,  and 
represents  the  local  Mcuiagement  Information  Department  (MID) 
staff  and  services.  Factor  B  is  made  up  of  questions  2,  and 
12,  and  represents  the  contractor's  services.  Factor  C  is 
made  up  of  questions  7,  8,  9,  10,  and  13,  emd  represents  the 
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information  product  output.  Factor  D  is  made  up  of  questions 
3,  4,  and  5,  and  represents  user  knowledge  and  involvement. 

3.  Confirmatory  Factor  Analysis 

Paramount  to  the  maximum  likelihood  factor  analysis 
procedure  is  that  the  data  be  multivariate  normal.  There  is 
no  easily  defined  test  for  multivariate  normality  that  could 
be  found  in  the  literature.  Instead,  the  Joreskog  and 
SSrbom's  (1989)  LISREL  model  for  analysis  of  non-normal 
varieJales  was  used.  The  Total  Coefficient  of  Determination 
(TCD)  for  the  variables  was  0.997  indicating  a  very  good  fit 
to  the  four- factor  solution.  Other  goodness  of  fit  indices 
used  supported  the  four- factor  solution.  The  Goodness  of  Fit 
Index  (QFI)  was  0.985,  cuid  the  Adjusted  Goodness  of  Fit  Index 
(AGFI)  was  0.977. 

The  Root  Mean  Square  Residual  (RMR)  was  0.041,  which 
also  supports  the  goodness  of  fit  of  the  four- factor  solution. 
Additionally,  Standard  Errors  (SE)  euid  t-values  (LISREL' S 
critical  ratios)  were  performed  for  each  of  the  variables 's 
loading  into  their  respective  factor.  The  SB's  were  all  low 
(<0.04),  and  the  t-values  were  all  large  (>20)  for  each  of 
varied>le  factor  loadings,  which  further  supports  the  goodness 
of  fit  of  the  four- factor  solution. 

4.  Reliability  (Internal  Consistency)  Testing 

Factor  A  is  made  up  of  questions  1,  6,  and  11,  and 
represents  the  local  Mamagement  Information  Department  (MID) 
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staff  and  services.  Factor  B  is  made  up  of  questions  2,  and 
12,  and  represents  the  contractor's  services.  Factor  C  is 
made  up  of  questions  7,  8,  9,  10,  and  13,  and  represents  the 
information  product.  Factor  D  is  made  up  of  questions  3,  4, 
and  5,  and  represents  knowledge  and  involvement. 

The  Cronbach's  alpha  for  factor  A  was  0.89;  for  factor 
B  was  0.68;  for  factor  C  was  0.87;  and  for  factor  D  was  0.75. 


TABLE  4.2 


MAXIMUM  LIKELIHOOD  FACTOR  AN^ 

H 

CO 

JITH  VAR 

IMAX  RO 

TATION 

QUESnONS/VASIABLES 

FACTOR 

A 

FACTOR 

B 

FACTOR 

C 

FACTOR 

D 

SMC 

1.  RELATKH^SHIP  WITH  MID  STAFF 

•■75 

0.18 

0.18 

0.20 

0.61 

2.  FROCESSINO  OF  REQUESTS  FOR  CHANOES 

0.12 

iM 

0.19 

0.16 

036 

3.  DEGREE  OF  TRAININO  PROVIDED 

0.27 

OM 

0.16 

SM 

0.43 

4.  USER’S  UNDERSTANDIHO  OF  SYSTEM 

0.16 

0.11 

0.10 

9:3 

037 

5.  USER’S  FEEUNQ  OF  PARTICIPATION 

0.25 

032 

030 

S:SI 

0.40 

6.  ATTITUDES  OF  MID  STAFF 

S.3 

0.14 

030 

0.15 

0.63 

7.  REUARniTY  OF  OUTPUT 

0.16 

0.25 

037 

0.07 

0.61 

8.  RELEVANCY  W  OUTPUT 

0.23 

0.32 

iSL 

0.15 

0.54 

9.  ACCURACY  OF  OUTPUT 

0.20 

0.13 

$.75 

0.09 

0.56 

la  PRECISION  OF  OUTPUT 

0.12 

0.05 

SJl 

0.19 

0.48 

11.  OOMMUNKATINO  WITH  MID  STAFF 

m 

0.14 

0.22 

0.19 

0.69 

12.  TIME  REQUIRED  FOR  NEW  DEVELOPMENT 

0.17 

0.23 

0.19 

0.45 

13.  COMnSTENBSSOFOUTPUT 

0.20 

0.44 

0.10 

0J7 

Ei(eoirdHe 

4.10 

2.30 

15.90 

1.30 

Cuaulnive  Pencot 

17» 

26% 

94% 

100% 

see 

0.80 

0.70 

0.94 

036 

- 

Cwnbwh’i  Ajplis 

0.89 

0.68 

0.87 

0.75 

- 

Sdmran  BqretiiD  Crilerioa  ^  211 

TMw  wd  Lewis  Kditbili^  Codlieieitt  -  0.9S 
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5.  Testing  for  Measurement  and  Structural  Invariance 

The  use  of  Joreskog  and  Sdrbom's  LISREL  model  to  test 
for  measurement  and  structural  invariance  revealed  that  the 
three  subpopulations  are  equivalent  for  their  responses  and 
the  four- factor  data  reduction.  Hypothesis  A  was  that  the 
covariance  structure  across  the  three  subpopulations  is 
invariant.  Hypothesis  B  was  that  the  nvimber  of  factors  of  the 
factor  structure  is  the  same  across  the  three  subpopulations 
is  invariant.  Hypothesis  C  was  that  the  factor  loading 
pattern  across  the  three  subpopulations  is  invariant. 
Hypothesis  D  was  that  the  error/uniqueness  structure  is 
invariant  across  the  three  sxibpopulations .  Hypothesis  E  was 
that  the  factor  variances  and  covariances  are  invariant  across 
the  three  subpopulations. 

As  mentioned  previously  in  Chapter  III,  the  chi- 
square/degrees  of  freedom  ratio  is  distributed  as  a  t- 
statistic  so  that  anything  greater  than  1.96  is  significant 
and  therefore  would  reject  the  null  hypothesis  of  invariance. 
Table  4.3  shows  the  results. 


TABLE  4.3 

EQUIVALENCE  TESTING 


1  HYPOTHESIS 

X* 

df 

LRTest  II 

H  A:  COVAKIANCESTRUCTUREISTHESAME 

242.2 

182 

1.33 

_ 

B:  NUMBER  OF  FACTORS  IS  THE  SAME 

331.2 

177 

1.87 

C:  FACTOR  LOAOINO  IS  THE  SAME 

341.0 

.  195 

1.75 

0.55 

D;  THEERRORAJNIQUENESSISTHESAME 

3S3.6 

221 

1.74 

1.19 

E:  FACTOR  VARIANCES  AND  COVARIANCES  ARE  THE  SAME 

394.5 

241 

1.64 

0.99 

45 


6.  Post  Survey  Interviews  (Convergent  Validity) 


During  the  one -day  visits  to  the  Naval  Hospitals  Camp 
Lejeune  and  Jacksonville,  time  constraints  limited  the  number 
if  individuals  that  were  interviewed  to  a  total  of  15 
(approximately  5%  of  the  total  sample  population) .  In  working 
around  individual  work  schedules,  an  equal  distribution  of 
interviews  was  obtained.  Of  the  total  15  interviews,  three 
were  with  physicians,  three  with  administrative  personnel, 
three  with  clinic  personnel,  three  with  laboratory  personnel, 
and  three  with  pharmacy  personnel.  During  the  interviews,  the 
individuals  were  asked  about  their  overall  impression  of 
satisfaction  (satisfied  or  dissatisfied)  ,  and  to  comment  ed>out 
the  system.  All  individuals  interviewed  had  at  least  nine- 
months  experience  with  the  CHCS.  Between  interviews,  there 
was  an  opportunity  for  first-hand  use  of  the  CHCS  at  the  Naval 
Hospital  Can^  Lejeune 's  training  room. 

The  majority  of  the  physicians  (2  out  of  3)  were 
overall  dissatisfied  with  the  CHCS.  They  cited  a  c\jmbersome 
menu  interface,  slow  response  time  of  the  system,  and  slow 
response  time  to  chcuige  the  system.  The  clinic, 
administrative,  IcJDoratory  and  pharmacy  personnel  interviewed 
expressed  they  were  satisfied,  but  also  echoed  the  same 
comments  as  the  physicians. 

Other  general  comments  offered  about  the  survey 
instrument  were;  1)  provide  an  exan^le--the  bipolar 
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adjective  pairs  tended  to  confuse  some  and  2)  the  instrument 
did  not  address  how  the  user  interacted  or  put  information 
into  the  system. 


D.  EVALUATION  OF  THE  INSTRUMENT'S  DATA 
1.  Testing  Differences  in  Means 

The  combined  three  hospital  data  set  was  used  to  test 
the  difference  in  meeins  between  the  three  user  groups  for 
each  of  the  13  questions,  overall  score,  and  factors.  Using 
the  combined  data  set,  each  user  group  was  tested  form 
differences  in  means  between  the  three  location  sites  (i.e.. 
Charleston  vs  Caitp  Lejeune  vs  Jacksonville)  .  Lastly,  each 
hospital's  data  was  tested  for  differences  in  means  between 
the  three  user  groups.  Figure  4.5  shows  the  level  of 
satisfaction  for  each  of  the  13  questions  and  by  each  user 
group . 
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MEASURE  OF  USER  SATISFACTION 

BY  INDIVIDUAL  QUESTIONS  AND  USER  GROUPS 


(idial  H 
Physicians 


«  «  V  « 

Medical  Support 


9  111  Ml  (it  Ml 

H  Administrative  Support 


Figure  4.5.  Measure  of  User  Satisfaction 


a.  Combined  HbspitcLl  Ilata 

(1)  Differences  Between  User  Groups.  Table  4.4A 
shows  the  ANOVA  testing  results  between  user  groups, 
significant  findings  (at  alpha  =  0.05)  are  underlined.  The 
Physician  group  saitple  size  consisted  of  79  participants;  the 
Medical  Support  group  consisted  of  207  participants;  and  the 
Administrative  Support  group  consisted  of  54  participants. 
The  a  posteriori  testing  for  normality  via  the  NSCORES 
correlation  demonstrates  that  the  data  has  a  normal 
distribution. 

Except  for  questions  9  and  10,  the  Hartley  Fmax  test 
revealed  homogeneity  of  variance  between  groups.  Questions  9 
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and  10  were  tested  using  the  Kruskal -Wallis  nonparametric 
ANOVA  testing  of  sample  medians.  The  nonparametric  findings 
also  showed  no  significant  difference  in  medians.  Questions 
7,  8,  9,  10,  and  13  which  make  up  Factor  C  (information 
product  output)  revealed  no  significant  differences.  Factor 
C  across  the  three  user  groups  means  were  within  the  "slightly 
satisfied"  range  (0  to  1) . 
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TABLE  4.4A 


COMBINED  HOi 

SPITALS  ANOVA  T. 

BSTING 

;  USER 

GROUPS 

QUESnONS^ACTORS 

USERO 

F 

p 

NSCORES 

HARTLEY 

P 

M 

■■ 

VALUE 

VALUE 

CORRELATION 

1.  RELATIONSHIP  WITH  MID 

STAFF 

0.U 

1.32 

1.65 

iM 

0.002 

0.98 

1.12 

2.  PROCESSING  OF  REQUESTS 

FOR  CHANGE 

.0.85 

•0.28 

-0.24 

m 

ISIS 

0.98 

1.54 

3.  DEGREE  OF  TRAINING 

.0.47 

0.39 

0.12 

LS 

0.99 

1.34 

4.  USER’S  UNDERSTANDING  OF 
SYSTEM 

4).19 

0.98 

1.03 

16J3 

0.000 

0.98 

1.17 

5.  USER’S  FEEUNO  OF 
RARTTCIPATTON 

4).ll 

0.94 

0.81 

lfb24 

^9 

0.98 

1.17 

6.  ATTTTUDE  OF  MID  STAFF 

1.12 

1.45 

1.79 

132 

0.0:3 

0.98 

1.13 

7.  REUABILmr  OF  OUTPUT 

1.10 

0.98 

0.94 

0.29 

0.752 

0.97 

1.41 

8.  RELEVANCY  OF  OUTPUT 

0.60 

1.04 

1.02 

2.94 

0.054 

0.97 

1.11 

9.  ACCURACY  OF  OUTPUT 

1.32 

1.20 

0.81 

2.43 

0.089 

0.97 

iM 

10.  PRECISION  OF  OUTPUT 

0.94 

0.72 

0.60 

1.26 

0.285 

0.98 

iM 

11.  COMMUNICA’nON  WITH  MID 
STAFF 

0.79 

1.17 

1.53 

18 

0.007 

0.98 

1.35 

12.  TIME  REQUIRED  FOR  NEW 
DEVELOPMENT 

•1.04 

0.05 

.C.13 

13.05 

^3 

0.99 

1.26 

13.  COMPLETENESS  OF  OUTPUT 

HB 

0.77 

0.73 

1.28 

0.279 

0.98 

1.16 

OVERALL  SOME 

4.54 

10.71 

10.62 

131 

11^9 

0.99 

1.69 

A.  MID  STAFF  AND  SERVICES 

0.93 

IJl 

1.66 

6.49 

isfi 

0.98 

1.15 

B.  CONTRACT  SERVICES 

-0.95 

-0.12 

-0.19 

I0A5 

K9 

0.99 

135 

C.  INFORMATION  OUTPUT 

0.88 

0.94 

0.82 

0.26 

0.772 

0.98 

1.61 

D.  K-IOWLEDGEAND 
INVOLVEMENT 

•0.26 

0.77 

0.65 

18.70 

^1 

0.99 

1.28 

NOTES: 

(1)  P  *  Flqriieini:  M  »  Medical  Suppoit;  A  =  Adtauniiwative  Support 
^  Hartky't  epproximale  erideal  value  »  l.SO  rt  alpha  >  0.Q5 


(2)  Significant  User  Group  Findings.  Table  4.4B 
represents  those  items  where  the  ANOVA  testing  in  Table  4.4A 
repealed  a  significeuit  difference  in  the  meeuis  between  the 


user  groups.  Scheffe  multiple  cotparison  testing  was  used  to 
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identify  the  individual  differences  between  user  groups. 
Physicians  were  less  satisfied  and  displayed  a  significant 
difference  between  the  other  two  user  groups  in  virtually  all 
the  individual  questions  that  make  up  Factor  A,  Factor  B  and 
Factor  D. 


TABLE  4.4B 

SCHEFFE  MULTIPLE  COMPARISON  TESTING;  USER  GROUPS 


QUESnONS/FACTORS 

USER  CROUPS  COMPAI 

tISON 

PHYSICIAN/ 
MEDICAL  SUPPORT 

PHYSICIAN/ 
ADMIN  SUPPORT 

MEDICAL  SUPPORT/ 
ADMIN  SUPPORT 

1.  RELATIONSHIP  WITH  MID  STAFF 

S(l) 

S 

NSO) 

2.  PROCESSINO  OF  REQUESTS  FOR 
CHANOES 

S 

NS 

NS 

3.  DECREE  OF  TRAINING  PROVIDED 

S 

NS 

NS 

4.  USER’S  UNDERSTANDING  OF 

SYSTEM 

s 

S 

NS 

3.  USER’S  FEEUNG  OF  PARTICIPATION 

S 

S 

NS 

6.  ATTTrUDES  OF  MID  STAFF 

NS 

s 

NS 

11.  COMMUNICATING  WITH  MID 

STAFF 

NS 

s 

NS 

12.  TIME  REQUIRED  FOR  NEW 
DEVELOPMENT 

S 

s 

NS 

OVERALL  SCMtE 

S 

s 

NS 

A.  MID  STAFF  AND  ^VKES 

s 

s 

NS 

B.  CWTRACTOR  SERVICES 

s 

s 

NS 

D.  KNOWLEDGE  AND  INVOLVEMENT 

s 

s 

NS 

NOTES: 

(1)  S  =  Sifiiifieait  differeace  m  meau 

(2)  NS  >  Nomricnificait;  no  differenw  in  meant 


(3)  Physician  Group  Differences  by  Site.  Table 
4.5A  shows  the  ANOVA  testing  results  for  Physician  user  group 
between  the  three  Naval  Hospital  (NH)  sites.  Significant 
findings  (at  an  alpha  of  0.05)  are  imderlined.  The  Physician 
group  sanqple  size  at  the  NH  Charleston  consisted  of  21 
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participants;  NH  Camp  Lejeune  consisted  of  22  participants; 
and  NH  Jacksonville  consisted  of  36  participants.  The  a 
posteriori  testing  for  normality  via  the  NSCORES  correlation 
demonstrates  that  the  data  has  a  normal  distribution.  Except 
for  questions  7  and  13,  the  Hartley  Fmax  test  revealed 
homogeneity  of  variance  between  the  groups.  Questions  7  and 
13  were  tested  using  the  Kruskal -Wallis  nonparametric  ANOVA 
testing  of  saunple  mediams.  The  nonj^rametric  findings  also 
showed  no  significant  difference  in  mediams. 

Questions  7,  8,  9,  10,  and  13  which  make  up  Factor 
C  revealed  no  significamt  differences.  Factor  C  across  the 
three  sites  for  Physiciam  group  were  essentially  within  the 
"slightly  satisfied"  ramge  (0  to  1)  .  Other  nonsignificant 
differences  in  meams  were  fotmd  for  questions  4  and  12. 
Questions  4  amd  12  both  were  essentially  within  the  "slightly 
dissatisfied"  ramge  (-1  to  0),  and  help  maUce  up  Factors  D  and 
B,  respectively. 
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TABLE  4.5A 

PHYSICIAN  GROUP  ANOVA  TESTING 


QUBSnONS/FACTORS 

LOCAT 

ION  SITE  M 

BANS  (1) 

F 

P 

nscores 

CORRELATION 

HARTLEY 

CH 

CL 

nc 

value 

value 

h'MAX(2) 

1.  RELATIONSHIP  WTTH  MID  STAFF 

1.38 

1.36 

0.29 

9.23 

0.000 

0.98 

1.70 

2.  PROCESSING  OF  REQUESTS  FOR 
CHANGE 

.0.45 

41.05 

.1.60 

8R1 

0.000 

0.98 

1.45 

3.  DEGREE  OF  TRAINING 

0.QS 

0.05 

.1.08 

5.99 

0.004 

0.99 

1.48 

4.  USER’S  UNDERSTANDING  OF 
SYSTEM 

0.14 

41.59 

41.14 

1.26 

0.289 

0.98 

1.23 

5.  USER’S  FEELING  OF 

PARTICIPATION 

0.55 

41.21 

41.44 

349 

0.05 

0.97 

1.69 

6.  ATTITUDE  OF  MID  STAFF 

1.57 

1.77 

0.46 

12.06 

0.000 

0.97 

1.72 

7.  RELIABILITY  OF  OUTPUT 

1.07 

1.32 

0.99 

0.47 

0.625 

0.95 

3.13 

8.  RELEVANCY  OF  OUTPUT 

0.57 

0.71 

0.54 

0.09 

0.913 

0.96 

1.10 

9.  ACCURACY  OF  OUTPUT 

1.41 

1.50 

1.17 

0.80 

0.451 

0.97 

1.98 

10.  PRECISION  OF  OUTPUT 

0.86 

0.86 

1.04 

0.32 

0.728 

0.98 

1.76 

n.  COMMUNICATION  WITH  MID 

STAFF 

1.36 

1.34 

0.13 

13.61 

^9 

0.99 

1.40 

12.  TIME  REQUIRED  FOR  NEW 
DEVELOPMENT 

.0.93 

41.52 

-1.42 

2.61 

0.075 

0.98 

1.15 

13.  COMPLETENESS  OF  OinPUT 

0.52 

0.84 

0.17 

1.51 

0.227 

0.98 

5.07 

overall  SCIEKE 

8.10 

8.39 

0.11 

7.21 

am 

0.97 

1.68 

A.  MID  STAFF  AND  SERVICES 

1.44 

1.49 

0.29 

14.69 

0.001 

0.98 

1.24 

B.  CONTRACT  SERVICES 

4).69 

41.28 

-1.50 

738 

LSI 

0.99 

1.74 

C.  INFORMATION  OUTPUT 

0.86 

1.04 

0.78 

0.51 

0.605 

0.97 

2.14 

D.  KNOWLEDGE  AND 

INVOLVEMENT 

0.25 

41.25 

41.56 

333 

0.045 

0.99 

2.05 

NOTES: 

(1)  CH  >  NH  ClMTlfftoo;  CL  NH  Camp  Lajeuoe;  )X  ^  NH  Ja^aonviOe 

(2)  Hutiqr’t  FmaXoj,,  approximatD  eritieal  value  =  ISl  at  a]|Ai  ac  0.05 


(4)  Significant  Physicicui  Group  Findings.  Tcible 
4.5B  represents  those  items  where  the  ANOVA  testing  in  Table 
4.5A  revealed  a  significant  difference  in  the  means  between 
the  Physician  groups.  Scheffe  multiple  cortqparison  testing  was 
used  to  identify  the  individual  differences  between  sites. 
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Physicians  at  the  NH  Jacksonville  were  less 
satisfied  amd  displayed  a  significant  difference  between  the 
other  two  sites  in  all  the  individual  questions  (l,  6,  and  11) 
that  niedce  up  Factor  A  (MID  Staff  and  Services)  .  The  NH 
Charleston  amd  the  NH  Camp  Lejeune  Factor  A  findings  were 
within  the  "quite  satisfied"  range  (1  to  2)  versus  the  NH 
Jacksonville's  findings  within  the  "slightly  satisfied"  range 
(0  to  1) . 

Physicians  at  the  NH  Jacksonville  were  less 
satisfied  auid  displayed  a  significamt  difference  between  the 
other  two  sites  for  Factor  B  (Contractor  Services;  questions 
2  amd  12)  .  Physicians  at  the  NH  Jacksonville  were  less 
satisfied  as  cosqpare  with  the  NH  Charleston  with  Factor  D,  but 
demonstrated  no  difference  between  the  NH  Canp  Lejeune.  The 
NH  Jacksonville,  and  the  NH  Caui^  Lejeune  findings  for  Factor 
D  were  within  the  "slightly  dissatisfied"  range  (-1  to  0) 
verses  the  NH  Charleston's  findings  within  the  "slightly 
satisfied"  ramge  (0  to  1) . 
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TABLE  4.5B 


SCHEFFE  MULTIPLE  COMPi 

MilSON  TESTING;  PHYSICIAN  GROUP 

QUESnONS/FACrORS 

UXVkTION  SITE  COMPAI 

OSON 

CHARLESTON/ 

CHARLESTON/ 

CAMP  LEJEUNE/ 

CAMP  LEJEUNE 

JACKSONVILLE 

JACKSONVILLE 

I.  RELATKmsmP  WITH  MID  STAFF 

NS(1) 

S(2) 

S 

2.  FROCESSINO  OF  REQUESTS  FOR  CHANGES 

NS 

S 

S 

3.  DEGREE  OF  TRAINING  PROVIDED 

NS 

S 

S 

S.  USER’S  FEEUNO  OF  PARTICIPATION 

NS 

s 

NS 

6.  ATTirUDES  OF  MID  STAFF 

NS 

s 

S 

II.  COMMUNICATHW  WITH  MID  STAFF 

NS 

s 

s 

OVERALL SCORE 

NS 

s 

s 

A.  MID  STAFF  AND  SERVICES 

NS 

s 

s 

B.  CC»nRACrOR  SERVICES 

NS 

s 

s 

D.  KNOWLEDGE  AND  INVOLVEMENT 

NS 

s 

NS 

NOTES: 

0)  NS  a  NooiignificiDl;  ao  diffintaee  in 
(2)  S  s  Si(iiificiat  diffioRnce  in  meau 


(5)  Medical  Support  Group  Differences  by  Site. 
Tcible  4 . 6A  shows  the  ANOVA  testing  results  for  Medical  Support 
user  group  between  the  three  naval  hospital  sites. 
Significant  findings  (at  alpha  =  0.05)  are  underlined.  The 
Medical  Support  group  sample  size  at  the  NH  Charleston,  Can^ 
Lejeune  emd  Jacksonville  consisted  of  71,  75  and  61 
participants  respectively.  The  a  posteriori  testing  for 
normality  via  the  NSCORES  correlation  demonstrates  that  the 
data  has  a  normal  distribution.  The  Hartley  Fmax  test 
revealed  homogeneity  of  variance  between  groups. 

Questions  7,  8,  9,  10,  and  13  which  make  up 
Factor  C  revealed  no  significant  differences.  Factor  C  across 
the  three  user  groups  means  were  essentially  within  the 
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"slightly  satisfied"  range  (0  to  1)  .  Other  nonsignificant 
differences  in  means  were  found  for  question  4.  Question  4 
was  essentially  within  the  "slightly  dissatisfied"  range  (0  to 
-1) ,  and  helps  make  up  Factor  D. 

TABLE  4.6A 


MEDICAL  SI 

rPPORT  GROUP  A 

^ESTI^ 

re 

QUESTIC»lS/FACTORS 

LO 

CATIONS] 

MEAmai 

rtE 

1 

F 

value 

p 

value 

nscores 

CORRELATION 

HARTLEY 

FMAX(2) 

CH 

CL 

JX 

1.  RELATIONSHIP  WITH  MID  STAFF 

1.74 

1.22 

0.94 

638 

0.98 

1.24 

2.  PROCESSINa  OF  REQUESTS  FOR 
CHANGE 

-0.42 

0.24 

-0.76 

&2 

8.001 

0.99 

1.69 

3.  DEORBEOFTRAiraNO 

0.82 

OM 

-0.30 

L2Z 

0.001 

0.98 

l.QS 

4.  USER'S  UNDERSTANDINa  OF 

SYSTEM 

1.33 

0.82 

0.77 

2.38 

0.078 

0.97 

1.42 

3.  USER’S  FEELING  OF  PARTiCIPATKM 

1.23 

0.99 

033 

hSi 

0.827 

0.98 

132 

6.  ATTITUDB  OF  MID  STAFF 

3.08 

1^3 

0.83 

16.91 

0.888 

0.98 

1.98 

7.  RELIABILITY  OF  OUTPUT 

0.80 

1.27 

OM 

234 

0.099 

0.97 

1.48 

1.  RELEVANCY  OF  OUTPUT 

1.06 

1.23 

0.76 

1.90 

0.131 

0.98 

1.26 

9.  ACCURACY  OF  OUTPUT 

1.31 

133 

0.91 

1.68 

0.189 

0.97 

1.20 

10.  PREOSiON  OF  OUTPUT 

0J8 

0.79 

0.79 

033 

0.391 

0.97 

1.22 

11.  COMMUNICATIW  WTTH  MID  STAFF 

1.73 

1.03 

0.68 

18.9a 

1^9 

0.98 

1.64 

13.  TIME  REQUIRED  FOR  NEW 
DEVELOPMENT 

0.10 

034 

-036 

3.88 

OJfi 

0.99 

1.32 

13.  COMPLETENESS  OF  OUTPUT 

0.68 

0.94 

0.67 

a63 

0336 

0.98 

1.21 

OVEKAIXSCOKE 

13.06 

12.08 

6.30 

LS2 

8387 

0.99 

1.23 

A.  MID  STAFF  AND  SERVICES 

1.83 

1.20 

14.10 

0.98 

1.64 

B.  OMITRACT  SERVICES 

•0.16 

0.29 

-0.36 

8.888 

0.99 

1.47 

C.  INFORMATION  OUTPUT 

0.89 

1.11 

0.79 

1.27 

0.284 

0.98 

1.26 

D.  KNOWLEDCEAND  INVOLVEMENT 

1.13 

0.76 

0.33 

636 

0.99 

1.29 

NOTES: 

(1)  CH  >  NH  dathiiloa;  CL  >  NH  Cnp  JX  »  NH  JackfoBviHe 

Cn  Hudqr’t  nyiwiiHiilB  oritkal  vahK  *  1.14  «  «  O.OS 
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(6)  Significant  Medical  Support  Group  Findings. 
TcQjle  4.6A  represents  those  items  where  the  ANOVA  testing  in 
TABLE  4.6A  revealed  a  significant  difference  in  the  means 
between  the  Medical  Support  groups.  Scheffe  multiple 
comparison  testing  was  used  to  identify  the  individual 
differences  between  sites. 

For  Factor  A,  the  NH  Charleston  was 
significantly  different  from  the  other  two  sites.  In  each  of 
the  individual  questions  the  NH  Charleston  was  more  satisfied 
("quite  satisfied"  range  of  1  to  2)  than  the  two  sites  which 
were  within  the  "slightly  satisfied"  range. 

For  Factor  B,  the  NH  Jacksonville  was  less 
satisfied  when  conqpared  with  the  NH  Canp  Lejetone,  but  had  no 
significcuat  difference  between  the  NH  Charleston.  Both  the  NH 
Jacksonville  and  Charleston  findings  for  Factor  B  were  within 
the  "slightly  dissatisfied"  reuige  (0  to  -1)  ,  whereas  the  NH 
Can?)  Lejeune  findings  for  Factor  B  were  within  the  "slightly 
satisfied"  reuige  (0  to  1)  .  Even  though  the  NH  at  Charleston 
and  Camp  Lejeune  have  opposing  findings  for  Factor  B,  they 
were  still  statistically  nonsignificant  for  differences 
between  their  respective  means. 

For  Factor  D,  the  NH  Jacksonville  scored  less 
satisfied  findings  as  con^ared  with  the  NH  Charleston,  but  no 
significant  difference  between  the  NH  Can^  Lejeune.  However, 
all  three  sites  for  Factor  D  scored  within  essentially  the 
"slightly  satisfied"  range  (0  to  1) . 
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TABLE  4.6B 

SCHEFFE  MULTIPLE  COMPARISON  TESTING;  MEDICAL  SUPPORT  GROUP 


QUESTK>NS/FACTOilS 

LOC 

ATTON  SITE  COMPARISONS 

CHARLESTON/ 

CAMPLEIEUNE 

CHARLESTON/ 

JACKSONVILLE 

CAJkfP  LEJEUNE/ 
JACKSONVILLE 

1.  RELATIONSHIP  WrrH  MID  STAFF 

S(l) 

S 

NS(2) 

2.  PROCESSINO  OF  REQUESTS  FOR  CHANCES 

NS 

NS 

S 

3.  DECREE  OF  TRAINING  PROVIDED 

NS 

S 

S 

3.  USER’S  FEEUNO  OF  PARTICIPATION 

NS 

S 

NS 

6.  ATTITUDES  OF  MID  STAFF 

S 

s 

NS 

11.  COMMUNICATION  WITH  MID  STAFF 

S 

s 

NS 

12.  TIME  REQUIRED  FOR  NEW  DEVELOPMENT 

NS 

NS 

NS 

OVERALL SC<»E 

NS 

s 

S 

A.  MID  STAFF  AND  SERVICES 

S 

s 

NS 

B.  CONTRACTOR  SERVICES 

NS 

NS 

S 

D.  KNOWLEDGE  AND  INVOLVEMENT 

NS 

s 

NS 

NOTES: 

(1)  S  ■  Sigmfirmt  <Uf(maee  in  mem 

(2)  NS  >  Nooncnifieeat;  bo  difleraKC  in  mem 


(7)  Administrative  Group  Differences  by  Site. 
Todsle  4.7A  shows  the  ANOVA  testing  results  for  Administrative 
Support  user  group  between  the  three  hospital  sites. 
Significamt  findings  (at  alpha  »  0.05)  are  underlined.  The 
Administrative  Support  group  sanple  size  as  NH  Charleston, 
Canp  Lejeune  euid  Jacksonville  consisted  of  9,  24,  and  21 
participants,  respectively.  The  a  posteriori  testing  for 
normality  via  NSCORES  correlation  demonstrates  that  the  data 
has  a  normal  distribution.  Except  for  Factor  B,  the  Hartley 
Fmeoc  test  revealed  homogeneity  of  variance  between  groups. 

Factor  B  was  tested  using  the  Kruskal -Wallis 
nonparametric  ANOVA  testing  of  sanple  medians.  The 
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nonparametric  findings  showed  significant  difference  in 
medians  (P  value  »  0.01) .  However,  the  Mann-Whitney  non 
parcunetric  pairwise  comparisons  were  the  same  as  the  Scheffe 
parametric  findings  shown  in  Table  4.7b.  Factor  D  was 
nonsignificant  for  differences  in  means  between  the  sites  with 
a  score  in  the  "slightly  satisfied"  range  (0  to  l) . 

TABLE  4.7A 


ADMINISTRATIV] 

E  SUPPORT  GROT 

JP  ANC 

IVA  TE! 

STING 

QUESnONS/FACTORS 

LO 

CATION  SI 
MEANS  ai 

rra 

1 

F 

VALUE 

p 

VALUE 

nscores 

CORRELATION 

HARTLEY 

FMAX(2) 

CH 

CL 

JX 

1.  RELATIONSHIP  WITH  MID  STAFF 

1.89 

2.19 

0.93 

IM 

0.97 

1.67 

2.  PROCESSINa  OF  REQUESTS  FOR 
CHANGE 

-1.28 

0.25 

-0.36 

5.04 

0.010 

0.97 

1.52 

3.  DEGREE  OF  TRAININO 

-0.11 

0.50 

-0.21 

1.20 

0.308 

0.99 

1.74 

4.  USER’S  UNDERSTANDING  OF 

SYSTEM 

0.00 

1.33 

1.22 

2.24 

0.117 

0.98 

1.41 

S.  USER’S  FEEUNG  OP  PARTICIPATION 

0.89 

1.31 

0.19 

335 

0.043 

0.99 

1.74 

6.  ATTITUDE  OF  MID  STAFF 

2.22 

2.42 

0.88 

1337 

mm 

0.96 

1.85 

7.  RELIABILITY  OF  OUTPUT 

0.06 

1.27 

0.93 

2.91 

0.064 

0.98 

132 

S.  RELEVANCY  OF  OUTPUT 

1.00 

1.35 

0.64 

1.60 

0.212 

0.97 

1.44 

9.  ACCURACY  OF  OUTPUT 

-0.30 

1.44 

0.64 

735 

0.98 

1.49 

10.  PRECISION  OF  OUTPUT 

-0A4 

1.08 

0.50 

5.17 

0.009 

0.98 

2.21 

11.  COMMUNICATION  WITH  MID  STAFF 

1.72 

2.17 

0.71 

835 

0.97 

1.14 

12.  TIME  REQUIRED  FOR  NEW 
DEVELOPMENT 

-1.06 

0.13 

-0.07 

1.83 

0.171 

0.99 

1.48 

13.  COMPLETENESS  OF  OUTPUT 

0.06 

1.04 

0.67 

136 

0.220 

0.98 

1.29 

OVEXALL  SCORE 

4.44 

16.48 

6.57 

539 

0.99 

1.68 

A.  MID  STAFF  AND  SERVICES 

1.95 

2.26 

0.84 

12.09 

BM 

0.97 

1.24 

B.  a»ITRACT  SERVICES 

-1.17 

0.19 

-0.21 

BW 

0.99 

1.74 

C.  INFORMATION  OUTPUT 

0.03 

1.24 

0.68 

4.66 

0.014 

0.98 

1.56 

D.  KNOWLEDGE  AND  INVOLVEMENT 

0.26 

1.05 

0J7 

2.04 

0.141 

0.99 

1.19 

NOTES: 

(1)  CH  »  NK  CbariMtoii;  CL  *  NH  Cap  Lqevac;  JX  »  NH  Jackioavilk 
Pi  Htflkgr’t  Rauxa,n>  <ppragdaut»  erilioal  vdae  m  3J0  at  aipbi  »  0.QS 
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(8)  Significant  Administrative  Support  Group 
Findings.  Table  4.7B  represents  those  items  where  the  ANOVA 
testing  in  Table  4.7A  revealed  a  significant  difference  in  the 
means  between  the  Administrative  Support  groups.  Scheffe 
multiple  con^jarison  testing  was  used  to  identify  the 
individual  differences  between  sites. 

The  Administrative  Support  group  at  the  NH 
Jacksonville  for  Factor  A  were  less  satisfied  than  the  other 
two  sites.  The  NH  at  Cait^  Lejeune  and  Jacksonville  were  both 
within  the  "quite  satisfied"  range  (l  to  2) ,  whereas  the  NH 
Jacksonville  was  within  the  "slightly  satisfied"  range  (0  to 
1)  . 

The  NH  Charleston  for  Factor  B  was  less 
satisfied  than  the  other  two  sites.  The  NH  Camp  Lejeune  for 
Factor  B  was  within  the  "slightly  satisfied"  range  (0  to  l) , 
and  the  NH  Jacksonville  was  within  the  "slightly  dissatisfied" 
range  (0  to  -1)  ,  but  was  not  statistically  different.  The  NH 
Charleston  for  Factor  B  was  within  the  "quite  dissatisfied" 
range  (-1  to  -2) . 

For  Factor  C,  the  NH  Charleston  was  less 
satisfied  compared  with  the  NH  Caitp  Lejeune,  however,  scored 
no  difference  with  the  NH  Jacksonville.  The  significauit 
influences  to  this  finding  was  the  significant  differences 
paralleled  with  questions  9  and  10  dealing  with  output 
accuracy  and  precision.  Both  the  NH  Camp  Lejeune  and  the  NH 
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Jacksonville  were  essentially  within  the  "slightly  satisfied" 
range  (0  to  1)  for  Factor  C,  whereas,  the  NH  Charleston  was 
"neutral"  with  a  zero  score. 

TABLE  4.7B 


SCHEFFE  MULTIPLE  COMPARISON  TESTING;  ADMIN  SUPPORT  GROUP 


QUESnONS/FACTORS 

LOC 

ATTON  SITE  COMPARISOI 

MS 

CKARLESTCM4/ 

CAMPLEmUNE 

CHARLESTON/ 

JACKSONVILLE 

CAMPLEIEUNE/ 

JACKSONVILLE 

1.  RELATIONSHIP  WITH  MIP  STAFF 

NS(1) 

NS 

S(2) 

2.  PROCESSINO  OF  REQUESTS  FOR  CHANGES 

S 

NS 

NS 

5.  USER’S  FEELING  OF  PARTICIPATION 

NS 

NS 

S 

6.  ATTITUDES  OF  MID  STAFF 

NS 

S 

S 

9.  ACCURACY  OF  OUTPUT 

S 

NS 

NS 

10.  PRECISION  OF  OUTPUT 

S 

NS 

S 

11.  COMMUNICATION  WITH  MID  STAFF 

NS 

NS 

S 

OVERALL  SOME 

S 

NS 

S 

A.  MID  STAFF  AND  SERVICES 

NS 

S 

S 

B.  CONTRACTOR  SERVICES 

S 

s 

NS 

C.  INFORMATION  OUTPUT 

s 

NS 

NS 

NOTES; 

(1)  NS  s  Noosigiiifieaat;  oo  differeoce  in  mem* 

(2)  S  >  Sifnifiemt  differcace  in  meau 


Jb.  The  Naval  Hospital  Charleston 

(1)  Differences  between  User  Groups.  Table  4.8A 
shows  the  ANOVA  testing  results  between  user  groups. 
Significant  findings  (at  alpha  =  0.05)  are  underlined.  The 
Physician  group  san^jle  size  consisted  of  21  participants;  the 
Medical  Support  group  consisted  of  71  participants;  and  the 
Administrative  Support  group  consisted  of  9  participants.  The 
a  posteriori  testing  for  normality  via  the  NSCORES  correlation 
demonstrates  that  the  data  has  a  normal  distribution.  The 
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disparity  in  the  size  of  the  user  groups  san^le  sizes  lead  to 
reject  homogeneity  of  variance  in  a  number  of  questions. 
However,  on  subsequent  testing  using  nonparametric  procedures 
revealed  essentially  the  same  results  and  patterns. 

TABLE  4.8A 


NH  CHARL 

ESTON 

USER 

GROU: 

P  ANOVj 

A  TESl 

?ING 

QUESnONS/FACTORS 

USER  GROUP  MEANS  (1) 

F 

VALUE 

P 

VALUE 

NSCORES 

CORRELATION 

HARTLEY 

FMAX(21 

P 

M 

A 

1.  RELATIONSHIP  WITH  MID 

STAFF 

1.38 

1.74 

1.89 

0.84 

0.433 

0.98 

1.38 

2.  PROCESSING  OF  REQUESTS 

FOR  CHANGE 

.0.43 

41.42 

.1.28 

1.08 

0.343 

0.99 

2.48 

3.  DEGREE  OF  TRAINING 

0.03 

0.82 

41.11 

2.49 

0.088 

0.98 

1.98 

4.  USER’S  UNDERSTANDING  OF 
SYSTEM 

0.14 

1.33 

0.00 

6.99 

^3 

0.98 

1.39 

3.  USER’S  FEELING  OF 
PARTICIPATION 

0.33 

1.23 

0.89 

1.70 

0.188 

0.97 

1.46 

d.  ATTrrUDE  OF  MID  STAFF 

1.37 

2.08 

2.22 

2.41 

0.093 

0.98 

1.31 

7.  RELIABILITY  OF  OUTPUT 

1.07 

0.80 

0.06 

1.33 

0.221 

0.98 

3.99 

8.  RELEVANCY  OF  OUTPUT 

0.37 

1.06 

1.00 

1.02 

0.366 

0.98 

1.39 

9.  ACCURACY  OF  OUTPUT 

1.41 

1.31 

41.30 

fjg 

0.882 

0.98 

LS 

10.  KEaSKWI  OF  OUTPUT 

0.86 

OM 

41.44 

2.77 

0.068 

0.98 

3Ji 

11.  COMMUNICATION  WITH  MID 
STAFF 

1.36 

1.73 

1.72 

0.89 

0.413 

0.98 

1.18 

12.  TIME  REQUIRED  FOR  NEW 
DEVELOPMENT 

.0.93 

0.10 

-1.06 

4.79 

0.99 

1.37 

13.  COMPLETENESS  OF  OUTPUT 

0.32 

0.68 

0.06 

0.78 

0.439 

0.99 

3.98 

OVERALL  SOME 

8.10 

13.06 

4.44 

IM 

0.99 

2.19 

A.  MID  STAFF  AND  SERVICES 

1.44 

1.83 

1.93 

1.38 

0.211 

0.98 

1.17 

B.  CONTRACT  SERVICES 

.0.69 

4}.I6 

-1.17 

hl2 

0.045 

0.99 

3.76 

C.  INFORMATION  OUTPUT 

0.89 

0.89 

0.03 

2.23 

0.113 

0.98 

1.83 

D.  KNOWLEDGE  AND 

INVOLVEMENT 

0.23 

1.13 

0.26 

5.79 

^3 

0.99 

1.22 

NOTES: 

(1)  P  *  Ftyiinin;  M  *  Medical  Support;  A  >  AdmaiiMive  Support 

(2)  Kartl^’s  FbmKojq  appwadmate  erilieal  value  >  2.33  at  alpha  »  0.03 
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(2)  Significant  User  Group  Findings.  Table  4.8B 
represents  those  items  where  the  ANOVA  testing  in  Table  4.8A 
revealed  a  significant  difference  in  the  means  between  the 
user  groups.  Physicians  were  less  satisfied  when  compared 
with  the  Medical  Support  group  for  Factor  D;  no  difference 
with  the  Administrative  Support  group.  Physicians  and  the 
Administrative  Support  group  were  within  the  "slightly 
satisfied"  range  (0  to  l)  .  Whereas,  the  Medical  Support  group 
was  within  the  "quite  satisfied"  range  (l  to  2) .  Factor  B  on 
multiple  con^arison  testing  found  that  there  was  no 
significant  difference  between  the  groups.  All  groups  for 
Factor  B  were  within  the  "slightly  dissatisfied"  range  (0  to  - 
1)  .  Again,  the  small  sample  size  of  the  Administrative 
Support  group  plays  a  role  in  the  resulting  nonsignificant 
findings. 

Interestingly,  the  Administrative  Support  group 
were  less  satisfied  than  the  other  two  groups  as  to  the 
accuracy  of  the  output.  However,  there  were  nonsignificant 
differences  between  all  groups  found  in  Factor  C. 
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TABLE  4.8B 

SCHEFFE  MULTIPLE  COMPARISON  TESTING; 


NH  C 

ElARLESTON  USER  GROUPS 

QUESTICmS/FACTOSS 

USER  GROUPS  COMPAl 

LISON 

PHYSICIAN/ 
MEDICAL  SUPPORT 

PHYSICIAN/ 
ADMIN  SUPPORT 

MEDICAL  SUPPORT/ 
ADMIN  SUPPORT 

4.  USER’S  UNDERSTANDINa  OP 

SYSTEM 

SO) 

NS© 

NS 

9.  ACCURACY  OF  OUTPUT 

NS 

S 

S 

12.  TIME  REQUIRED  FOR  NEW 
DEVELOPMENT 

S 

NS 

NS 

OVERALL SCORE 

NS 

NS 

NS 

B.  CONTRACTOR  SERVICES 

NS 

NS 

NS 

D.  KNOWLEDGE  AND  INVOLVEMENT 

S 

NS 

NS 

NOTES: 

(1)  S  »  Sjtnifieaot  diffeiaiee  ia  meau 

(2)  NS  V  Namgaificaot;  no  difimnee  in  mcau 


c.  naval  Hospital  Caap  Lejeune 

(1)  Differences  between  User  Groups.  Ta±>le  4.9A 
shows  the  ANOVA  testing  results  between  user  groups. 
Significant  findings  (at  alpha  »  0.05)  are  underlined.  The 
Physician  group  sample  size  consisted  of  22  participants;  the 
Medical  Support  group  consisted  of  75  participants;  and  the 
Administrative  Support  group  consisted  of  24  participemts. 
The  a  posteriori  testing  for  normality  via  the  NSCORES 
correlation  demonstrates  that  the  data  has  a  normal 
distribution.  Except  for  questions  6  and  9,  the  Hartley  Fnax 
test  revealed  homogeneity  of  variance  between  groups. 
However,  on  subsec[uent  testing  using  nonparcuaetric  procedures, 
resulted  in  finding  the  same  values  and  patterns. 
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Although  the  Physician  group's  mean  value  for 
Factor  B  was  within  the  "slightly  dissatisfied"  range  (0  to  - 
1)  ,  and  the  other  two  groups  were  within  the  "slightly 
satisfied"  range  of  (0  to  l)  ,  there  was  no  significant 
difference  in  means  between  the  groups.  There  was  no 
significant  difference  between  the  three  groups  concerning  the 
information  product  output  (Factor  C) .  All  three  groups  were 
within  the  "quite  satisfied"  range  (l  to  2)  for  Factor  C. 
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TABLE  4.9A 


NH  CAMP  L] 

BJEUNE  USER  GROl 

UP  ANO’ 

VA  TE£ 

5TING 

QUESnONS/FACTORS 

USERG 

ROUPMEi 

U4Sa) 

F 

value 

p 

value 

NSCORES 

CORRELATKW 

HARTLEY 

FMAX(2) 

P 

M 

A 

1.  RELATIONSHIP  WITH  MID 

STAFF 

1.36 

1.22 

2.19 

5.78 

0.98 

1.76 

2.  raOCESSlNO  OF  REQUESTS 
FORCHANOE 

.0.0S 

0.24 

0.25 

0.37 

0.690 

0.98 

1.25 

3.  OEOREEOFTRAININa 

0.QS 

0.52 

0.50 

0.75 

0.475 

0.99 

1.07 

4.  USER’S  UNDERSTANDING  OF 
SYSTEM 

■0.59 

0.82 

1J3 

7.95 

0.001 

0.98 

1.17 

S.  USER’S  FEEUNO  OF 
PARTICIPATION 

■0.21 

0.99 

1.31 

IM 

MSI 

0.99 

1.47 

6.  ATTITUDE  OF  MID  STAFF 

1.77 

1.33 

2.42 

7.09 

0.001 

0.98 

m 

7.  REUABIUTY  OF  OUTPUT 

1.32 

\.71 

1.27 

0.01 

0.989 

0.96 

1.31 

8.  RELEVANCY  OF  OUTPUT 

0.71 

1.23 

1J5 

1.64 

0.199 

0.98 

1.30 

9.  ACCURACY  OF  OUTPUT 

1.S0 

1.33 

1.44 

0.19 

0.828 

0.98 

10.  PRECISION  OF  OUTPUT 

0.86 

0.79 

1.08 

0.45 

0.637 

0.97 

1.54 

11.  COMMUNICATION  WITH  MID 
STAFF 

1.34 

1.09 

2.17 

0.98 

2.07 

12.  TME  REQUIRED  FOR  NEW 
DEVELonOENT 

4»J2 

0.34 

0.13 

2.63 

0.076 

0.99 

1.50 

13.  COMH^TENESS  OF  OUTPUT 

0.84 

0.93 

1.04 

0.11 

0.897 

0.98 

1.41 

OVERALL  SOME 

8.39 

12.08 

16.48 

2.53 

0.084 

0.99 

1.54 

A.  MID  STAFF  AND  SERVICES 

1.49 

1.20 

2.26 

8A5 

1^9 

0.98 

1.43 

B.  CXmTRACT  SERVICES 

-0.28 

0.29 

0.19 

1.64 

0.199 

0.99 

1.13 

C.  INFORMATION  OUTPUT 

1.03 

1.11 

1.24 

0.20 

0.823 

0.99 

1.39 

D.  KNOWLEDGE  AND 

INVOLVEMENT 

-0.25 

0.78 

1.05 

6.61 

^3 

0.99 

1.21 

NOTES: 

(1)  P  °  R^tont;  M  *  Mcdkal  Support;  A  Adnunutruive  Support 
9)  Hutlqr’i  FmaXg^  opprtMuimte  crilieal  vakie  >  2.24  «t  alpha  «  O.QS 


(2)  Significant  User  Group  Findings.  Table  4.9B 
represents  those  items  where  the  ANOVA  testing  in  Table  4 . 9A 
revealed  a  significeint  difference  in  the  means  between  the 
user  groups.  Scheffe  multiple  comparison  testing  was  used  to 
identify  the  individual  differences  user  groups. 
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The  Medical  Support  group  was  less  satisfied 
when  conpared  with  the  Administrative  Support  group  for  Factor 
A,  and  no  significant  difference  with  the  Physicicui  group. 
The  Medical  Support  group  and  the  Physician  group  for  Factor 
A  were  within  the  "quite  satisfied"  range  (1  to  2) ,  whereas 
the  Administrative  Support  group  was  within  the  "extremely 
satisfied"  range  (2  to  3) .  The  Physician  Support  group  was 
less  satisfied  for  Factor  D  than  the  two  other  groups.  The 
Physician  Support  group  for  Factor  D  were  within  the  "slightly 
dissatisfied"  range  (0  to  -1) ,  whereas,  the  other  two  groups 
were  essentially  within  the  "slightly  satisfied"  range  (0  to 
1)  . 


TABLE  4.9B 

SCHEFPE  MULTIPLE  COMPARISON  TESTING; 
NH  CAMP  LEJBUNE  USER  GROUP 


QUESnONSn'ACTOIlS 

USER  CROUPS  COMPARISON 

mYSICIAN/ 
MEDICAL  SUmiRT 

PHYSICIAN/ 
ADMIN  SUPPORT 

MEDICAL  SUPPORT/ 
ADMIN  SUPPORT 

1.  RELATIONSHIP  WITH  MID  STAFF 

NSO) 

NS 

S(2) 

4.  USER’S  UNDERSTANDING  OF  SYSTEM 

S 

S 

NS 

5.  USER’S  FEEUNO  OF  PARTICIPATION 

S 

s 

NS 

6.  ATTITUDES  OF  MID  STAFF 

NS 

NS 

S 

11.  CXIMMUNICATINO  WITH  MID  STAFF 

NS 

NS 

S 

A.  MID  STAFF  AND  SERVICES 

S 

NS 

S 

D.  KNOWLEDGE  AND  INVOLVEMENT 

s 

S 

NS 

NOTES: 

(1)  NS  •  NoDt^iiifieiiit;  no  difference  in  means 

(2)  S  =  Significant  difference  in  meais 
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d.  Jibval  HospitaLL  Jacksonville 

(1)  Differences  between  User  Groups.  Table  4.10A 
shows  the  ANOVA  testing  results  between  user  groups. 
Significant  findings  (at  alpha  »  0.05)  are  underlined.  The 
Physician  Support  group  sample  size  consisted  of  36 
participants;  the  Medical  Support  group  consisted  of  61 
participants;  cuid  the  Administrative  Support  group  consisted 
of  21  participants.  The  a  posteriori  testing  for  normality 
via  the  NSCORES  correlation  demonstrates  that  the  data  has  a 
normal  distribution.  The  Hartley  Fmax  test  revealed 
homogeneity  of  variance  between  the  user  groups. 

There  was  no  significemt  difference  between 
user  group  mecins  for  Factor  C.  All  user  groups  were  within 
the  "slightly  satisfied"  range  (0  to  1)  for  Factor  C. 
Question  3  dealing  with  the  degree  of  training  was  found 
initially  to  have  significant  differences  in  user  group  mecuis. 
However,  on  subsequent  testing  as  denoted  in  Table  4.10B, 
there  was  no  significant  difference.  All  user  groups  for 
(question  3  were  essentially  within  the  "slightly  dissatisfied" 
range  (0  to  -1) . 
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TABLE  4.10A 


NH  JACKSO] 

fJVILLE  USER  GROl 

JP  ANO' 

7A  TE£ 

STING 

QUESnONS/FACrORS 

1  USER  GROUP  MEANS  (1) 

F 

value 

p 

value 

NSCORES 

CORRELATION 

HARTLEY 

P 

M 

A 

FMAX(2) 

1.  RELATIONSHIP  WITH  MID 

STAFF 

0.29 

0.94 

0.93 

3.70 

0.028 

0.99 

1.44 

2.  PROCESSINO  OF  REQUESTS 

FOR  CHANGE 

-1.38 

-0.76 

-0.36 

5.18 

0.007 

0.99 

2.19 

3.  DEGREE  OF  TRAINING 

-1.08 

-OJO 

-0.21 

3.29 

&941 

0.99 

1.38 

4.  USER’S  UNDERSTANDING  OF 
SYSTEM 

-0.14 

0.77 

1.12 

0.004 

0.98 

1.18 

S.  USER’S  FEELING  OF 
PARTICIPATION 

-0.44 

0.33 

0.19 

4.81 

0.010 

0.99 

2.00 

6.  ATTITUDE  OF  MID  STAFF 

0.46 

0.83 

o.n 

1.34 

0.263 

0.98 

1.89 

7.  REUABEJTY  OF  OUTPUT 

0.99 

0.81 

0.93 

0.17 

0.846 

0.97 

1.12 

8.  RELEVANCY  OF  OUTPUT 

C.34 

0.76 

0.64 

0.26 

0.772 

0.98 

1.07 

9.  ACCURACY  OF  OUTPUT 

1.17 

0.91 

0.64 

1.02 

0.364 

0.97 

1.31 

10.  PRECISION  OF  OUTPUT 

1.04 

0.79 

OJO 

1.34 

0.266 

0.99 

1.81 

11.  COMMUNICATION  WITH  MID 
STAFF 

0.13 

0.68 

0.71 

2.61 

0.078 

0.99 

2.01 

12.  TIME  REQUIRED  FOR  NEW 
DEVELOPMENT 

-1.42 

•0.36 

-0.07 

SM 

0.99 

1.40 

13.  COMPLETENESS  OF  OUTPUT 

0.17 

0.67 

0.67 

1.13 

0.319 

0.97 

1.64 

OVERALL  SC<»E 

0.11 

6.30 

6.37 

3.19 

0.045 

0.99 

2.22 

A.  MID  STAFF  AND  SERVICES 

0.29 

0.83 

0.84 

2.96 

0.036 

0.98 

1.74 

B.  CONTRACT  SERVICES 

-1.30 

-0.36 

-0.21 

7J7 

0.99 

2.09 

C.  INFORMATION  OUTPUT 

0.78 

0.79 

0.68 

0.07 

0.931 

0.98 

1.39 

D.  KNOWLEDGE  AND 

INVOLVEMENT 

-0J6 

0J3 

0S7 

0.99 

2.09 

NOTES: 

(1)  P  »  nqrticaiis;  M  *  Medicil  Support;  A  ~  Admioiilntive  Support 

(2)  Hoitlqr’i  RbuXojh  critical  value  •  2.2S  at  a^pha  O.OS 


(2)  Significant  User  Group  Findings.  TcdDle  4.10B 
represents  those  items  where  the  ANOVA  testing  in  Table  4.10A 
revealed  a  significauit  difference  in  the  means  between  the 
user  groups.  Scheffe  multiple  comparison  testing  was  used  to 
identify  the  individual  differences  between  user  groups. 
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The  Physician  Support  group  was  significantly 
less  satisfied  for  Factor  B  thcui  the  other  two  user  groups. 
The  Medical  Support  group  and  the  Administrative  Support  group 
for  Factor  B  were  within  the  "slightly  dissatisfied"  range  (0 
to  -1)  whereas,  the  Physician  group  was  within  the  "quite 
dissatisfied"  ramge  (-1  to  -2)  .  The  Physician  group  was 
significantly  less  satisfied  for  Factor  D  than  the  two  other 
user  groups.  The  Medical  Support  group  and  the  Administrative 
Support  group  for  Factor  D  were  within  the  "slightly 
satisfied"  range  (0  to  1)  whereas,  the  Physician  group  was 
within  the  "slightly  dissatisfied"  range  (0  to  -1)  . 


TABLE  4.10B 

SCHEFFE  MULTIPLE  COMPARISON  TESTING; 
NH  JACKSONVILLE  USER  GROUP 


QUESnONS/FACTORS 

USER  GROUPS  COMPARISON 

PHYSKIAN/ 
MEDICAL  SUPPORT 

PHYSICIAN/ 
ADMIN  SUPP(»T 

MEDICAL  SUPPORT/ 
ADMIN  SUPPORT 

1.  RELATKMOHIPWrrH  MID  STAFF 

SO) 

NS(2) 

NS 

2.  PROCBSSINO  OF  REQUESTS  FOR 
CHANOES 

S 

S 

NS 

3.  OEORBEOFTRAlNINaFROVIDEO 

NS 

NS 

NS 

4.  USER’S  UNDERSTANDINO  OF 

SYSTEM 

S 

S 

NS 

3.  USER’S  FEEUNO  OF  PARTIOPATION 

S 

NS 

NS 

12.  TIME  REQUIRED  FOR  NEW 
DEVELOPBCENT 

S 

S 

NS 

OVERALL  SCORE 

S 

S 

NS 

B.  CC»frRACTORSERVICES 

S 

S 

NS 

D.  KNOWLEDGE  AND  INVOLVEMENT 

s 

s 

NS 

NOTES: 

(1)  S  >■  SipafitMt  diflcKnee  to  annt 
CZ)  NS  »  Woowpiificl;  ao  dMhwacc  to 
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V.  MDLTZDIMBNSIQNAL  SCALING  DESCRIPTIVE  FINDINGS 


A.  INTRODUCTION 

This  chapter  discusses  the  results  of  employing 
multidimensional  scaling  to  raw  data  collected  from  Naval 
Hospitals  Charleston,  Camp  Lejeune  and  Jacksonville.  In  the 
sections  that  follow,  we  discuss  the  goodness  of  fit  of  the 
data  to  the  solution,  the  stimulus  coordinates  cuid  finally  the 
spatial  map  for  those  coordinates. 

B.  GOODNESS  OF  FIT 

In  Chapter  IV,  we  discussed  the  goodness  of  fit  and  its 
relationship  to  determining  the  dimensionality  of  data  once  it 
is  processed  through  ALSCAL.  Nhile  Kruskal  and  Wish  (1978) 
say  this  measure  is  a  "very  in^ortant  consideration  in 
determining  how  many  dimensions  are  appropriate,  they  also 
suggest  that  the  STRESS  value  "has  received  the  most 
systematic  statistical  study" .  The  results  of  rxinning  the 
raw  data  for  the  hospitals  euid  the  combination  for  all 
hospitals  are  presented  below.  Table  5.1  shows  the  STRESS  and 
RSQ  values  for  each  hospital  and  the  combined  hospitals. 
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TABLE  5.1 

GOODNESS  OF  FIT  DATA 


HOSPTTAL 

RSQ 

Ckariotoo 

0.101 

0.956 

CiBp  Lqeuoe 

0.107 

0.94« 

Jaektooville 

0.0*7 

0.992 

AHHoipjlib 

0.066 

0.9t3 

In  order  to  derive  the  S- STRESS  value,  ALSCAL  goes  for 
seven  iterations  before  reaching  a  value  which  is  less  thcui 
0.001  (the  S- STRESS  Iii5)rovement )  (SPSS,  1988)  .  With  each 
iteration  the  value  for  S-STRESS  decreases.  Likewise,  the 
value  of  the  squared  correlation  coefficient  (RSQ)  is  also 
chouiging.  However,  RSQ  indicates  the  amount  of  error.  The 
smallness  of  the  difference  between  the  two  values  shows  how 
good  the  fit  is  between  the  data  and  the  solution.  NH 
Charleston  has  a  S-STRESS  of  0.101  and  RSQ  of  0.956, 
indicating  the  fit  is  fairly  good  but  not  perfect. 

The  fit  of  data  to  solution  for  NH  Carp  Lejeiine  is 
slightly  better.  Its  S-STRESS  value  is  0.107  euid  RSQ  is 
0.948.  Carp  Lejeune  stops  the  iterations  after  five  times 
when  it  reaches  eui  irprovement  less  them  0.001.  Results  for 
NH  Jacksonville  were  reached  after  only  four  iterations.  The 
S-STRESS  value  is  0.047  emd  RSQ  of  0.992.  This  value  is 
almost  perfect  indicating  the  fit  at  Jacksonville  is  very 
good.  Finally,  the  findings  for  Combined  Hospitals  data  shows 
a  S-STRESS  of  0.066  and  RSQ  of  0.983.  These  measures  were 
reached  after  six  iterations. 
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C.  STIMULUS  COORDINATES  AND  SPATIAL  MAP 


Before  a  spatial  map  is  produced,  ALSCAL  generates  a  set 
of  coordinates  for  each  variable  based  on  the  number  of 
dimensions.  Theses  coordinates  are  then  plotted  on  the  graph 
to  show  the  relative  similarity  of  the  variables. 

1.  Naval  Hospital  Charleston  (CHAS) 

Table  5.2  shows  the  coordinates  (dimensions)  for  NH 
Charleston.  A  Stimulus  Number,  Stimulus  Name  and  Plot  Symbol 
are  assigned  by  ALSCAL  b  sed  on  the  variable  name  inputs  to 
the  procedure.  The  configuration  that  results  is  the 
coordinates  and  the  spatial  map  for  the  plot  symbols. 

TABLE  5.2 

STIMULUS  COORDINATES  (CHAS) 


DIMENSION 


$TIHW.U3 

STIMULUS 

EtOT 

1 

2 

NUHMDt 

make 

SVTmOL 

* 

RE'.MrO 

I 

t.S<«9 

0.1725 

CM53VS 

2 

-C.7442 

-0.5054 

5 

TIN  IQ 

S 

*0.4944 

-1.2419 

4 

UNCCTSTD 

4 

0.5572 

-l.<24S 

5 

tartic 

S 

0.5(55 

0.5157 

4 

HJPATF 

« 

1.929Z 

0.2455 

7 

HELVINFO 

7 

-0.2595 

0.4950 

« 

HCLVINFO 

9 

0.2945 

0.4021 

9 

ACCII^O 

9 

0.5571 

0.5255 

10 

WICCIW 

A 

-0.4410 

-0.2754 

11 

NtKCHN 

B 

1.2959 

-0.2552 

12 

TIHEOCV 

C 

-1.5174 

1.0205 

IS 

coutlete 

D 

-0.5424 

0.2455 

Each  coordinate  corresponds  to  a  plot  on  graph. 
Figure  5.1  depicts  the  derived  stimulus  coordinates.  Starting 
in  the  upper  right-hand  corner  and  moving  counterclockwise  on 
graph,  the  quadrants  are  labeled  QUAD  I,  QUAD  II,  QUAD  III, 
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and  QUAD  IV  respectively.  Plot  symbols  1,  6,  8,  and  9  are 
located  in  QUAD  I.  Plot  symbols  7,  C,  and  D  are  located  in 
QUAD  II.  The  remainder  of  the  variables  are  located  in  QUAD 
III  (3  and  A)  and  IV  (4  and  B) .  Plot  symbol  2  does  not  plot 
on  the  graph  because  it  is  outside  of  the  coordinate  axes.  In 
statistical  jargon  it  would  be  called  an  outlier.  The 
groupings  for  the  quadrants  are  1)  User  Assessment  of 
Information  Characteristics  {QUAD  I)  ,  2)  System  Changes/ 
Contractor  Services  (QUAD  II),  3)  User  Involvement  (QUAD  III) 
and  4)  User  Relations  with  MID  (QUAD  IV) . 
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matrix  FILf 

OCRlVfD  'STtHUtUS  CCMFtCURATtON:  DlMfHSION  1  (HORIZONTAt)  V3  01»CMCION  2  (VERTICAL) 


Figure  5.1.  NH  Charleston  Spatial  Map 
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2.  Naval  Hospital  Caa^  Lejeime  (JUNE) 


Data  for  NH  Caunp  Lejeune  was  processed  by  ALSCAL  and 
produced  the  results  found  in  Table  5.3.  Stimulus  Coordinates 
along  with  the  number,  ncime  and  plot  symbol  are  shown  in  Table 
5.3  The  information  for  each  hospital  is  the  same  in  the 
table  except  for  the  coordinates. 

TABLE  5.3 

STIMULUS  COORDINATES  (JUNE) 


OlMCHSiaM 


TtMUtOS 

STtHULUS 

1 

2 

NUHsn 

NA»C 

SVH«QL 

1 

WLMTU 

1 

1 .  tan 

-0.4104 

CH(?3YS 

2 

-i.ASsa 

t.541S 

s 

TRMO 

5 

-l.7S7» 

-0.51S4 

< 

UNOCftSTD 

< 

-1.4219 

s 

^MTIC 

S 

-0.4SSS 

-0.5070 

< 

HIDATT 

0 

-0.4S17 

7 

ftCLVfHPO 

7 

a.7S7i 

0.4019 

t 

<tCLVI»#0 

a 

o.s4ia 

0.1475 

f 

ACCtl>rO 

♦ 

1.2024 

0.0905 

to 

ARCctiro 

A 

0.2952 

0.0514 

It 

MI0C0>!M 

i 

I.S4U 

-0.2401 

12 

riHEccv 

C 

-i.m? 

0.4459 

ts 

COHPUtC 

0 

0.1909 

0.5552 

The  configuration  that  results  from  the  coordinates  in  TeJDle 
5.3  is  Figure  5.2.  The  spatial  map  for  NH  Camp  Lejeune  shows 
the  groupings  for  the  data.  In  QUAD  I,  plot  symbols  7,  8,  9, 
A,  and  D  are  found.  Plot  symbols  2  and  C  are  located  in  QUAD 
II.  Plot  symbols  3,  4,  and  5  are  found  in  QUAD  III  and  QUAD 
IV  holds  plot  symbols  1,  6,  and  B.  The  general  groupings  for 
each  quadrant  are  the  Scune  as  listed  in  Section  C.l. 
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MAT«]K  r\Vi 

OCRlVeO  stimulus  COM^IGIKATION:  DIMCNSION  1  IHORITO^jrAL)  V3  0JHCN310N  2  tVERTICAL) 


Figure  5.2.  NH  Ceunp  Lejeune  Spatial  Map 


3.  Naval  Hospital  Jacksonville  (JAX) 


Table  5.4  shows  the  coordinate  data  for  NH 
Jacksonville.  Coordinate  pairs  for  each  of  the  13  variadales 


used  in  the  short  form  questionnaire  are  displayed.  These 
coordinates  are  shown  in  Figure  5.3  plotted  on  the  graph  to 
depict  the  relationship  of  the  data  in  a  spatial  map. 

TABLE  5.4 

STIMULUS  COORDINATES  (JAX) 


DIHCNSIOK 

STIMULUS  SrtMXUS  PLOT  1  2 

NUHKft  HAMS  SYMBOL 


1 

PCLHIO 

1 

1.1323 

-0.0543 

2 

CMCSVS 

2 

-2.7150 

0.2430 

S 

TfiMC 

3 

-1.7443 

-0.7352 

4 

ifttoeRSTo 

4 

0.SS4S 

-1.3727 

S 

PAKTIC 

5 

-0  5103 

-0.4234 

i 

MtOATT 

« 

0  71*2 

-0.5000 

7 

RELVINTO 

7 

I.04BO 

0.3474 

« 

RCLVtNTO 

t 

0.7555 

0.5100 

? 

ACCtMFQ 

9 

1.1230 

0.4337 

10 

ppsci»ro 

A 

0.0400 

-0.0400 

11 

MI0CCI« 

B 

0.3311 

-0.2005 

12 

TIHCOEV 

C 

-1  nu 

0.?2»0 

IS 

CfR^LEIE 

D 

0.3M0 

0.9120 

The  configuration  that  results  from  Table  5.4  is  shown  as 
Figure  5.3.  In  Figure  5.3,  the  plot  symbols  are  displayed  in 
the  quadrant  corresponding  to  their  coordinates.  In  QUAD  I 
are  7,  8,  9,  A,  and  D.  In  QUAD  II  is  C.  Plot  symbols  3  and 
5  are  in  QUAD  III  and  plot  symbols  1,  6,  and  B  are  found  in 
QUAD  IV. 
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•MIKtX  PILE 

DCRIVtO  STIMULUS  COnaURAriaN:  OIHEWSIOM  I  (HMIZONTALl  VS  DIHEMSIQH  Z  (VERTICAL) 


Figure  5.3.  NH  Jacksonville  Spatial  Map 


4.  Coaidbined  Hospital  Data  (AUiHOSP) 

The  coordinates  for  the  Combined  Hospital  Data  is 
found  in  Table  5.5.  Along  with  the  stimulus  number,  naune  and 
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plot  symbol  are  the  dimensions  for  graphing  the  stimulus. 
This  data  is  significant  because  it  shows  what  happens  with  a 
very  large  samples  size. 

TABLE  5.5 

STIMULUS  COORDINATES  (ALLHOSP) 


DIHCNSION 


STtHULUS 

81 IHULUS 

1 

2 

MtMCR 

NAME 

flCLHID 

t 

I.SOSO 

0.0052 

2 

CHC8VS 

2 

-2. 4280 

0.4408 

S 

TIlflG 

S 

-1.2788 

-1.2281 

4 

WlOCflSTO 

4 

0.9S08 

-1.7153 

S 

rARTlC 

> 

-0.9«5 

-0.4483 

< 

MiPAn 

« 

l.4S4t 

-0.1204 

7 

ttSLVO^O 

7 

0.5274 

0.5817 

8 

^ELVIN^O 

8 

e.sois 

0.4484 

« 

ACCl'.TO 

8 

1 .0242 

0.5178 

to 

r«eciwFo 

A 

0.S555 

0.3784 

11 

HIDCOMH 

» 

0.8382 

-0.2448 

12 

Ti«rev 

C 

-2.0431 

0.7138 

IS 

CO^^LCTC 

0 

-0.1040 

0.4485 

In  Figure  5.4,  the  coordinates  are  plotted  in  the 
coordinate  plane  for  each  variable.  In  QU7VD  I,  plot  symbols 
7,  8,  9,  and  A  are  found.  Plot  symbols  of  C  and  D  are 
displayed  in  QUAD  II.  In  QUAD  III  are  plot  symbols  3  and  5. 
Plots  for  1,  6,  and  B  are  located  in  QUAD  IV. 
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VI.  ANALYSIS  OF  FINDINGS 


A.  INTRODX7CTION 

This  chapter  will  cover  analysis  of  the  multidimensional 
scaling  findings  only.  One  section  however,  will  cover 
comparative  aspects  of  the  studies. 

B.  GOODNESS  OF  FIT 

Multidimensional  scaling  was  used  to  determine  the 
relationships  among  13  varieibles  and  to  identify  the  smallest 
number  of  underlying  dimensions  which  would  adequately 
represent  those  13  variables  (Harris,  1977) .  Interpreting  the 
pattern  or  structure,  which  is  often  hidden  in  a  proximity 
matrix,  representing  in  a  spatial  map  is  the  virtue  of  MDS. 
Consequently,  the  fewer  dimensions  used,  the  better. 

The  key  step  in  assessing  the  fit  is  determining  the 
labels  for  the  axes  in  a  spatial  map.  The  group  names  used  in 
Chapter  V  are  useful  in  neuning  the  axes.  In  QUAD  I  (User 
Assessment  of  Information  Characteristics) ,  notice  that  the 
coordinates  are  positive  on  the  vertical  and  the  horizontal 
axes  for  User  Assessment.  In  QUAD  II  (System 
Chcuiges/Contractor  Services) ,  the  coordinates  are  negative  on 
the  horizontal  cucis  and  positive  on  the  vertical  cucis.  There 
is  a  negative  horizontal  euid  vertical  axis  in  QUAD  III  (User 
Involvement)  .  In  QUAD  IV  (User  Relations  with  MID)  ,  the 
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coordinates  are  positive  on  the  horizontal  cocis  and  negative 
on  the  vertical  aocis. 

C.  LABELING  THE  AXES 

In  Chapter  II,  we  discussed  cost  benefit  analysis  as  it 
relates  to  UIS.  Cost  benefit  analysis  is  an  ever  present 
management  issue  and  is  one  that  is  sometimes  difficult  to 
accoit^lish  because  of  the  intangibles  associated  with  benefit. 
We  have  ladoeled  the  vertical  axis  as  COST  and  the  horizontal 
axis  as  BENEFIT. 

In  general,  information  technology  tends  to  be  costly. 
Both  hardware  and  software  cost  are  on  the  increase. 
Additionally,  within  DoD,  we  find  this  cost  coupled  with 
almost  double  the  regulations.  Consequently,  the  hassle  of 
acquiring  an  information  system  is  a  cost.  There  are  cost 
involved  in  building  and  maintaining  relationships  with 
vendors  and  MIS  staff.  Particularly  in  government  when  a 
contractor  can  cheuige  from  one  phase  of  a  project  to  the  next 
phase.  Time  spent  managing  the  systems,  learning  the  system, 
using  the  system  is  also  a  cost.  We  find  that  as  our  workload 
increases  because  of  the  availability  of  information  systems 
we  have  less  time  to  do  our  job  for  the  same  reason.  Finally, 
opportunity  costs  are  ever  present.  These  cost  elements  all 
play  a  role  in  UIS.  They  have  positive  and  negative  affects 
on  the  users  of  information  systems. 
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Benefits  of  information  systems  from  the  user's 
perspective  takes  on  as  many  faces  as  does  cost.  The  main 
benefit  is  the  amount  of  information  we  receive  as  a  result  of 
information  systems.  There  is  a  benefit  to  learning  to  use 
information  system.  Information  systems  are  also  used  as 
learning  tools  and  teaching  aids.  Our  jobs  are  made  easier 
because  of  information  systems  and,  while  they  may  be  time 
consuming,  they  allow  us  to  make  better  decisions  with 
information  at  our  fingertips. 

D.  COST/BENEFIT  AMD  HOSPITAL  ANALYSIS 

By  adding  the  ladjels  of  COST  and  BENEFIT  to  the  aixis,  we 
can  better  interpret  what  is  meant  when  a  variable  falls  in  a 
particular  guadretnt.  They  now  cam  depict  characteristics 
associated  with  costs  and  benefit.  Additionally,  this 
enhamces  our  understamding  of  the  relationships  among  the 
variables  as  they  cluster  in  a  specific  guadramt. 

1.  Naval  Hospital  Charleston 

Figure  6.1  is  the  saune  as  Figure  5.1  with  the  axes 
labels  added.  At  each  end  of  the  vertical  axis  are  the  lad^els 
HIGH  COST  and  LOW  COST.  At  each  end  of  the  horizontal  aixis 
are  the  labels  HIGH  BENEFIT  and  LOW  BENEFIT. 

Quadramt  one  now  represents  characteristics  that  have 
a  high  benefit  and  high  cost.  This  is  akin  to  high  risk  and 
high  gain.  The  variables  RELMID,  MIDATT,  RELVINFO,  and 
ACCINFO  in  QUAD  I  have  a  high  cost  amd  a  high  benefit 
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associated  with  them.  However,  RELMID  and  MIDATT  seem  as  if 
they  should  fall  in  QUAD  IV.  In  analyzing  all  data,  note  that 
the  Charleston  data  were  collected  by  different  experimenter 
at  a  different  time  from  the  other  two  hospitals.  Therefore, 
the  results  of  NH  Charleston,  has  more  variance  than  the 
others  two  and  the  ALLHOSP  data.  It  would  stand  to  reason 
that  we  incur  greater  costs  to  get  relevant  and  accurate 
information.  On  that  Soime  note,  the  respondents  get  a  higher 
return  in  the  accuracy  of  information. 

In  QUAD  II,  TIMEDBV  and  COMPLETE  are  consistent  with 
high  cost  and  low  benefits.  However,  RELYINFOR  seems  to  be 
misplaced  in  this  quadrant.  Usually  if  we  pay  more  to  get 
more  reliadDle  information  the  benefits  of  the  data  is  better. 
In  this  case  the  cost  was  countered  with  possible  error  rates 
which  were  seen  as  a  lower  benefit.  Low  benefits  were 
associated  with  low  costs  for  training  of  personnel.  In  QUAD 
III,  TRNG  and  PRECINFO  are  clustered  together.  User's 
understcmding  of  the  system  (UNDERSTD)  is  clustered  in  QUAD  IV 
with  MIDCOMM. 
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Figure  6.1.  NH  Charleston  with  Labels 


Not  surprising,  NH  Charleston  shows  the  most  variance  of  the 
three  hospitals. 


2.  Naval  Hospital  Camp  Lejeune 


Figure  6.2  is  the  same  as  Figure  5.2  with  the  aixes 
labels  added.  The  variables  RELYINFO,  RELVINFO,  ACCINFO, 
PRECINFO,  and  COMPLETE  fall  in  QUAD  I.  High  cost  and  high 
benefit  characterizes  this  quadrant.  Information  systems 
managers  must  spend  tremendous  cost  in  order  to  gain  the 
equally  high  benefit  of  reliable,  relevant,  accurate,  precise, 
and  complete  information  as  outputs  from  the  system. 

In  QUAD  II,  changes  to  the  system  whether  by  the 
contractor  or  in-house  staff  tend  to  be  costly  although  the 
benefit  may  not  be  as  high  as  the  cost.  Variables  in  QUAD  III 
are  TRNG,  UNDERSTD,  and  PARTIC,  indicating  that  both  cost  and 
benefit  in  this  area  of  user  involvement  are  relatively  low. 
In  QUAD  IV,  the  relationship  of  users  with  MID  staff  is 
reflected  by  the  variables  located  here.  Areas  of 
communication,  attitude,  and  basic  relationships  with  the  MID 
staff  Cem  often  be  low  cost  if  they  are  in-house.  The 
benefits  in  this  area  tend  to  be  quite  high. 
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to  NH  Cairqp  Lejeune.  The  only  difference  in  this  graph  is 
between  quadrant  three  and  four.  User's  understanding  of  the 
system  has  moved  to  QUAD  IV  where  the  characteristics  are  high 
benefit  and  low  cost.  An  explanation  of  this  behavior  would 
be  that  at  Jacksonville  personnel  feel  that  a  higher  benefit 
could  be  gained  from  incurring  greater  costs  to  help  users 
understand  the  system.  In  QUAD  I,  precision  of  output  falls 
on  the  border  between  user  assessment  of  information 
characteristics  and  user  relations  with  MID  staff.  This  would 
indicate  a  tug  of  war  between  the  user's  perception  of  the 
system  and  their  relationship  with  MID. 

4.  Combined  Hospital  Data 

Figure  6.4  is  the  same  as  Figure  5.4  with  the  axes 
leJaels  added  to  it.  In  general.  Figure  6.4  was  similar  to  NH 
Camp  Lejeune  and  Jacksonville.  Charleston  Naval  Hospital 
varied  from  this.  In  Figure  6.4,  variables  that  fall  in  QUAD 
I  are  those  related  to  user  assessment:  RELYINFO,  RELVINFO, 
ACCINFO,  and  PRECINFO.  On  the  horizontal  axis  is  RELMID  which 
tends  to  indicate  overall  for  the  hospitals  cost  of  having  a 
relationship  with  MID  is  not  a  factor  but  benefits  in  this 
area  are  still  high.  In  the  area  of  user  involvement  (QUAD 
III)  user's  understanding  of  the  system  has  shifted  to  QUAD 
IV.  This  is  in  part  due  to  the  variance  in  Charleston  data. 
User's  feel  that  the  cost  and  benefit  associated  with 
understanding  the  system  is  fairly  low. 
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Figure  6.3.  NH  Jacksonville  with  labels 


MATRIX  »ILC 

miVCD  STIMULUS  CON’PIOUPATIONj  DIMFMSIOM  1  (H0«1?0W1AL)  VS  DIMtNSIOH  2  (VF^TICALJ 


Figure  6.4.  Combined  Hospitals  with  labels 
E.  COMPARISON  OF  RESULTS 

Factor  analysis  and  multidimensional  scaling  are  both 
dimensional  analysis  techniques.  In  general,  the  differences 
between  factor  analysis  and  multidimensional  scaling  lies  in 
how  data  is  displayed  and  processed.  Schiffmann  et  al.  (1981) 
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describes  the  differences  in  terms  of  how  data  is  represented. 
In  MDS  data  are  represented  as  distance  between  variables, 
whereas  in  factor  analysis,  the  variables  are  based  on  the 
angles  between  vectors.  The  advantage  of  MDS  over  factor 
analysis  comes  in  the  interpretation.  Factor  analysis  assumes 
linear  relationships  between  variables,  while  MDS  does  not. 
The  result  is  fewer  dimensions  with  MDS  than  with  factor 
analysis . 

1.  Differences  in  Factor  Analysis  Results 

Loc]chart  (1992)  suggested  that  user  satisfaction  by 
factor  differs  depending  on  the  user  groups  (Physician, 
Medical  Support,  Administrative  Support) .  His  analysis  shows 
increased  user  satisfaction  with  increased  relationship  with 
MID.  On  the  opposite  side  is  increased  dissatisfaction  with 
Contractor  service.  In  the  areas  of  Infoimation  Product 
Outputs,  users  were  satisfied  with  the  outputs  with  no 
significant  variance  among  the  user  groups.  Factor  D  showed 
the  user  groups  to  satisfied  for  both  Administrative  and 
Medical  Support.  However,  the  physicians  were  dissatisfied  in 
this  area. 

The  results  of  multidimensional  scaling  are  slightly 
different  from  those  of  Lockhart  (1992)  .  One  reason  for  this 
is  that  the  data  in  his  study  did  not  include  user 
demographics.  Thus  this  analysis  is  more  general  in  teims  of 
the  varicd5les  rather  them  the  user  groups.  Additionally,  MDS 
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spatial  maps  make  it  easier  than  factor  analysis  to  grasp 
where  variables  cluster  together  relative  to  the  axes. 
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VII .  CONCLUSIONS 


The  objective  of  this  study  was  to  determine  if 
multidimensional  scaling  revealed  more  about  user  perception 
of  satisfaction  with  information  systems  than  did  factor 
analysis.  The  answer  is  yes.  Multidimensional  scaling 
revealed  meaning  in  the  user  satisfaction  data  that  was  not 
apparent  in  factor  analysis.  Moreover,  it  does  it 
graphically. 

There  was  no  hint  of  the  cost-benefit  dimensions  in  the 
Hurd (1991)  and  Lockhart  (1992)  factor  analyses.  Their 
findings  were  at  the  level  of  the  obvious  labelling  of  factor 
loadings.  This  study  probed  deeper  into  their  data  to  reveal 
meanings  otherwise  hidden.  While  the  end  results  were  not 
substantially  different  from  those  using  factor  analysis,  what 
we  did  determine  is  that  MDS  sheds  different  light  on  the  same 
data. 
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APPENDIX  A. 


Part  A:  General  Information 


1.  Hospital  Department:  (Check  one) 

_  General  Administration 

_  Nursing  Administration 

_  Dietary 

_  Emergency 

_  Laboratory 

_  Outpatient  Clinic 

_  Outpatient  Nursing 

_  Pharmacy 

_  Radiology 

_  Other  (Specify) : _ 

2.  Job  Description:  (Check  one) 

_  Clerk 

_  Corpsman  (0000) 

_  Technician 

_  Nurse 

_  Pharmacist 

_  Physician 

_  Physician  Assistant 

_  Other  (Specify) : _ 

3.  Highest  Level  of  Education:  (Check  one) 

_  High  School  Graduate 

_  Some  College 

_  Bachelor's  Degree 

_  Some  Graduate  Work 

_  Master's  Degree 

_  Doctoral  Degree 

_  Medical  Degree 

_  Other  (Specify) : _ 

4.  Age:  _  years 

5.  Gender:  _  Mhle  _  Female 

6.  Length  of  time  (in  months)  you  have  used  CHCS:  _ 

7.  Have  you  used  other  computer  systems  before  _  No 

your  answer  was  Yes,  was  it  a  health  care 
information  system?  _  Yes  _  No 


If 
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Part  B:  The  Questionnaire 

This  section  of  the  survey  conveys  your  own  personal  feelings 
concerning  the  use  of  the  Composite  Health  Care  system  at  Naval 
Hospital,  (LOCATION) .  Please  do  not  attempt  to  analyze  the 
questions.  Remember,  there  are  no  right  or  wrong  answers. 

Please  follow  these  instructions: 

a.  Check  each  scale  in  the  position  that  describes  your  evaluation 
of  the  factor  being  described. 

b.  Check  each  scale,  do  not  omit  any. 

c.  Check  only  one  position  for  each  scale. 

d.  Check  in  the  space,  not  between  spaces.  THIS,  NOT  THIS 

:  X  :  X  : 

e.  Work  rapidly.  Rely  on  your  first  impressions. 

The  scale  positions  are  defined  as  follows: 

adjective  x: _ : _ : _ : _ ; _ : _ : _ :adjective  Y 

(1)  (2)  (3)  (4)  (5)  (6)  (7) 

(1)  extremely  X(5)  slightly  Y 

(2)  quite  X  (6)  quite  Y 

(3)  slightly  X(7)  extremely  Y 

(4)  neither  X  or  Y;  equally  X  or  Y;  does  not  apply 

ANSWERS  BASED  ON  YOUR  OWN  FEELINGS 

1.  Relationship  with  the  Management  Information  Department  (MID)  staff 

dissonant  : _ : _ : _ : _ : _ : _ : _ :  harmonious 

bad  : _ : _ : _ : _ : _ : _ : _ :  good 

2 .  Processing  of  requests  for  changes  to  existing  systems 

fast  : _ : _ : _ : _ : _ : _ : _ :  slow 

untimely  : _ : _ : _ : _ : _ : _ : _ :  timely 

3.  Degree  of  training  provided  to  users 

complete  : _ : _ : _ : _ ; _ : _ : _ :  incomplete 

: _ : _ : _ :  high 


low  : 
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4 .  Your  understanding  of  systems 

insufficient  : _ : _ : _ : _ : _ : _ :  sufficient 

complete  : _ : _ : _ : _ : _ : _ :  incomplete 

5.  Your  feeling  of  participation 

positive  : _ : _ : _ : _ : _ : _ :  negative 

insufficient  : _ : _ : _ : _ : _ ; _ :  sufficient 

6.  Attitude  of  the  Management  Information  Department  staff 

cooperative  : _ ; _ : _ : _ : _ : _ ;  belligerent 

negative  : _ : _ : _ : _ : _ : _ :  positive 

7 .  Reliability  of  output  information 

high  : _ : _ : _ : _ : _ : _ :  low 

superior  ; _ : _ : _ : _ : _ : _ :  inferior 

8.  Relevancy  of  output  information  to  intended  function  (degree  of  what 
user  wcuits  or  requires  and  what  is  provided  by  the  system) 

useful  : _ : _ : _ : _ : _ ; _ :  useless 

relevant  : _ : _ : _ : _ ; _ : _ ;  irrelevant 

9.  Accuracy  of  output  information 

inaccurate  ; _ ; _ ; _ ; _ : _ : _ :  accurate 

low  ; _ : _ : _ ; _ : _ : _ :  high 

10.  Precision  of  output  information  (the  variability  of  the  output 
information  from  that  which  it  purports  to  measure) 

low  : _ : _ ; _ ; _ : _ : _ ;  high 

definite  : _ : _ ; _ : _ : _ : _ ;  uncertain 

11.  Communication  with  the  Management  Information  Department  staff 

dissonant  : _ : _ : _ : _ : _ ; _ ; _ :  harmonious 

destructive  : _ : _ : _ : _ ; _ : _ : _ :  productive 
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12.  Time  required  for  new  systems  development 
unreasonodJle  : _ : _ : _ : _ : _ : 


acceptable  : 


13 .  Completeness 

of  the  output 

information 

sufficient  : 

•  •  • 

•  •  • 

• 

adequate  : 

•  •  • 

•  •  • 

Thank  you  for  your 

cooperation 

reasonable 

unacceptable 

insufficient 

inadequate 
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APPENDIX  B 


CHCS  -  COMBINED  3  HOSPITAL  DATA 
SHORT-FORM  UIS  INSTRUMENT  OVERALL  STATISTICS 


TOTAL  NUMBER  OF  SURVEYS:  340 
RESPONSE  RATE  (680  SENT)  50% 
MEDIAN  EDUCATION  LEVEL:  1 
AVERAGE  AGE:  32 
MINIMUM  AGE:  18 
MAXIMUM  AGE:  61 
NUMBER  OF  MALES:  213 
NUMBER  OF  FEMALES:  127 
PERCENT  MALES:  63% 
PERCENT  FEMALES:  37% 
AVERAGE  MONTHS  USED:  12.3 
MIN  MONTHS  USED:  1 
MAX  MONTHS  USED:  36 
NtJMBER  USED  COMPUTER  BEFORE  271 
PERCENT  USED  BEFORE:  80% 
NUMBER  USED  HLT  CARE  COMPTR  200 
PERCENT  USED  HC  COMP  BEFORE  59% 
PERCENT  USED  BEFORE  AND 

USED  HC  SYSTEM  BEFORE  74% 


Some  College 
years 
years 
years 


NO.  PERSN 

MONTHS  USE  1-5: 

67 

20% 

NO.  PERSN 

MONTHS  USE  6-11: 

98 

29% 

NO.  PERSN 

MONTHS  USE  12-17: 

81 

24% 

NO.  PERSN 

MONTHS  USE  18  >: 

94 

28% 

QUEST  1 

QUEST  2 

QUEST  3 

QUEST  4 

QUEST  5 

QUEST  6 

AVERAGE 

1.27 

-0.41 

0.15 

0.72 

0.68 

1.43 

STD  DEV 

1.29 

1.62 

1.73 

1.68 

1.57 

1.30 

MIN  NUMBR 

-3 

-3 

-3 

-3 

-3 

-3 

MAX  NUMBR 

3 

3 

3 

3 

3 

3 

QUEST  7 

QUEST  8 

QUEST  9 

QUEST  10 

QUEST  11 

QUEST  12 

AVERAGE 

1.00 

0.93 

1.16 

0.75 

1.14 

-0.23 

STD  DEV 

1.42 

1.41 

1.38 

1.32 

1.36 

1.67 

MIN  NUMBR 

-3 

-3 

-3 

-3 

-3 

-3 

MAX  NUMBR 

3 

3 

3 

3 

3 

3 

QUEST  13  OVERALL 

AVERAGE  0.69  9.26 

STD  DEV  1.53  12.77 

MIN  NUMBR  -3  -28 

MAX  NUMBR  3  39 
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MID 

STAFF/ SERV 
FACTOR  A 
(1,6,11) 
AVERAGE  1.28 

STD  DEV  1 . 19 

MIN  NUMBR  -3 

MAX  NUMBR  3 


CONTRACTOR 
STAFF/SERV 
FACTOR  B 
(2,12) 
-0.32 
1.43 
-3 
3 


INFORMATION 
PRODUCT 
FACTOR  C 
(7,8,9,10,13) 
0.91 
1.15 
-3 
3 


KNOWLEDGE  & 
INVOLVEMENT 
FACTOR  D 
(3,4,5) 
0.51 
1.35 
-3 
3 


NAVAL  HOSPITAL  CHARLESTON,  SC 
CHCS,  SHORT-FORM  UIS  INSTRUMENT  STATISTICS 


TOTAL  NUMBER  OF  SURVEYS: 
RESPONSE  RATE  (180  SENT) : 
MEDIAN  EDUCATION  LEVEL: 
AVERAGE  AGE: 

MINIMUM  AGE: 

MAXIMUM  AGE: 

NUMBER  OF  MALES:  (Percent) 
NUMBER  OF  FEMALES: 

AVERAGE  MONTHS  USED: 

MIN  MONTHS  USED: 

MAX  MONTHS  USED: 

NUMBER  USED  COMPUTER  BEFORE 
PERCENT  USED  BEFORE: 

NUMBER  USED  HLT  C7^  COMPTR 
PERCENT  USED  HC  COMP  BEFORE 
PERCENT  USED  COMP  BEFORE  AND 
USED  HC  SYSTEM  BEFORE: 

NO.  PERSN  MONTHS  USE  1-5: 

NO.  PERSN  MONTHS  USE  6-11: 

NO.  PERSN  MONTHS  USE  12  >: 


AVERAGE 

QUEST  1 
1.68 

QUEST  2 
-0.50 

STD  DEV 

1.22 

1.67 

MIN  NUMBR 

-2 

-3 

MAX  NUMBR 

3 

3 

AVERAGE 

QUEST  7 
0.79 

QUEST  8 
0.96 

STD  DEV 

1.47 

1.39 

MIN  NUMBR  -3 

-3 

MAX  NUMBR  3 

3 
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56% 


Some  college 

32 

years 

19 

years 

56 

years 

57 

(56%) 

44 

(44%) 

8.6 

1 

19 

83 

82% 

59 

58% 

71% 

28 

28% 

36 

36% 

37 

36% 

QUEST  3 

QUEST  4 

QUEST  5 

QUEST  6 

0.57 

0.97 

1.07 

1.99 

1.72 

1.60 

1.57 

1.00 

-3 

-3 

-3 

-1.5 

3 

3 

3 

3 

QUEST  9 

QUEST  10 

QUEST  11 

QUEST  12 

1.17 

0.54 

1.65 

-0.22 

1.50 

1.43 

1.14 

1.64 

-3 

-3 

-0.5 

-3 

3 

3 

3 

3 

QUEST  13 
AVERAGE  0.59 

STD  DEV  1.44 

MIN  NUMBR  -3 

MAX  NUMBR  3 


OVERALL 

11.26 

11.80 

-13.5 

39 
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MID  CONTRACTOR  INFORMATION  KNOWLEDGE  & 

STAFF/SERV  STAFF/SERV  PRODUCT  INVOLVEMENT 

FACTOR  A  FACTOR  B  FACTOR  C  FACTOR  D 

(1,6,11)  (2,12)  (7,8,9,10,13)  (3,4,5) 

AVERAGE  1.77  -0.36  0.81  0.87 

STD  DEV  0.99  1.34  1.17  1.25 

MIN  NUMBR  -1  -3  -3  -2 

MAX  NUMBR  333  3 


NAVAL  HOSPITAL  CAMP  LEJEUNE,  NC 
CHCS,  SHORT-FORM  UIS  INSTRUMENT  STATISTICS 


TOTAL  NUMBER  OF  SURVEYS:  121 

RESPONSE  RATE  (250  SENT) :  48% 

MEDIAN  EDUCATION  LEVEL:  Some  college 


AVERAGE  AGE: 

33 

years 

MINIMUM  AGE: 

18 

years 

MAXIMUM  AGE: 

61 

years 

NUMBER  OF  MALES:  (Percent) 

73 

(60%) 

NUMBER  OF  FEMALES:  (Percent) 

48 

(40%) 

AVERAGE  MONTHS  USED: 

12.5 

MIN  MONTHS  USED: 

1 

MAX  MONTHS  USED: 

36 

NUMBER  USED  COMPUTER  BEFORE 

92 

PERCENT  USED  BEFORE: 

76% 

NUMBER  USED  HLT  CARE  COMPTR 

63 

PERCENT  USED  HC  COMP  BEFORE 

52% 

PERCENT  USED  BEFORE  AND 

USED  HC  SYSTEM  BEFORE 

68% 

NO.  PERSN  MONTHS  USE  1-5: 

21 

17% 

NO.  PERSN  MONTHS  USE  6-11: 

44 

37% 

NO.  PERSN  MONTHS  USE  12-17: 

27 

27% 

NO.  PERSN  MONTHS  USE  18  >: 

29 

29% 

QUEST  1 

QUEST  2 

QUEST  3 

QUEST  4 

QUEST  5 

QUEST  6 

AVERAGE 

1.44 

0.19 

0.44 

0.67 

0.84 

1.63 

STD  DEV 

1.27 

1.41 

1.68 

1.82 

1.48 

1.30 

MIN  NUMBR 

-2 

-3 

-3 

-3 

-3 

-1.5 

MAX  NUMBR 

3 

3 

3 

3 

3 

3 

QUEST  7 

QUEST  8 

QUEST  9 

QUEST  10 

QUEST  11 

QUEST  12 

AVERAGE 

1.28 

1.16 

1.38 

0.86 

1.31 

0.14 

STD  DEV 

1.29 

1.35 

1.26 

1.29 

1.39 

1.57 

MIN  NUMBR  -3 

-3 

-3 

-3 

-3 

-3 

MAX  NUMBR  3 

3 

3 

3 

3 

3 
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QUEST  13  OVERALL 


AVERAGE  0.94  12.28 

STD  DEV  1.46  12.41 

MIN  NUMBR  -3  -25 

MAX  NUMBR  3  39 


MID 

STAFF/SERV 
FACTOR  A 
(1,6,11) 


CONTRACTOR  INFORMATION 
STAFF/SERV  PRODUCT 
FACTOR  B  FACTOR  C 

(2,12)  (7,8,9,10,13) 


KNOWLEDGE  & 
INVOLVEMENT 
FACTOR  D 
(3,4,5) 


AVERAGE  1.46  0.17 

STD  DEV  1.17  1.32 

MIN  NUMBR  -1  -3 

MAX  NUMBR  3  3 


1.12 

1.07 

-3 

3 


0.65 

1.38 

-3 

3 


NAVAL  HOSPITAL  JACKSONVILLE,  FL 
CHCS,  SHORT-FORM  UIS  INSTRUMENT  STATISTICS 


TOTAL  NUMBER  OF  SURVEYS: 
RESPONSE  RATE  (250  SENT): 
MEDIAN  EDUCATION  LEVEL: 
AVERAGE  AGE: 

MINIMUM  AGE: 

MAXIMUM  AGE: 

NUMBER  OF  MALES:  (Percent) 
NUMBER  OF  FEMALES:  (Percent) 
AVERAGE  MONTHS  USED: 

MIN  MONTHS  USED: 

MAX  MONTHS  USED: 

NUMBER  USED  COMPUTER  BEFORE 
PERCENT  USED  BEFORE: 


118 

47% 

BACHELOR  DEGREE 
32  YEARS 
19  YEARS 
56  YEARS 
83  (70%) 

35  (30%) 

15.3 

1 

32 

102 

86% 


NUMBER  USED  HLT  CARE  COMPTR  78 

PERCENT  USED  HC  COMP  BEFORE  66% 


PERCENT  USED  BEFORE  AND 

USED  HC  SYSTEM  BEFORE  76% 


NO.  PERSN 

MONTHS 

USE 

1-5: 

18 

15% 

NO.  PERSN 

MONTHS 

USE 

6-11: 

18 

15% 

NO.  PERSN 

MONTHS 

USE 

12-17: 

22 

19% 

NO.  PERSN 

MONTHS 

USE 

18  >: 

60 

51% 

QUEST  1 

QUEST  2 

QUEST  3 

QUEST  4 

QUEST  5 

QUEST  6 

AVERAGE 

0.74 

-0.94 

-0.53 

0.56 

0.17 

0.74 

STD  DEV 

1.22 

1.57 

1.60 

1.58 

1.55 

1.23 

MIN  NUMBR 

-3 

-3 

-3 

-3 

-3 

-3 

MAX  NUMBR 

3 

3 

3 

3 

3 

3 
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QUEST  7  QUEST  8 

AVERAGE  0.89  0.67 

STD  DEV  1.47  1.47 

MIN  NUMBR  -3  -3 

MAX  NUMBR  3  3 

QUEST  13  OVERALL 

AVERAGE  0.52  4.46 

STD  DEV  1.66  12.63 

MIN  NUMBR  -3  -28 

MAX  NUMBR  3  36 


QUEST  9  QUEST  10  QUEST  11  QUEST  12 
0.94  0.81 

1.36  1.22 

-3  -3 

3  3 


0.52  -0.63 

1.25  1.72 

-3  -3 

3  3 


MID 

STAFF/ SERV 
FACTOR  A 
(1,6,11) 


CONTRACTOR  INFORMATION 
STAFF/SERV  PRODUCT 

FACTOR  B  FACTOR  C 

(2,12)  (7,8,9,10,13) 


KNOWLEDGE  & 
INVOLVEMENT 
FACTOR  D 
(3,4,5) 


AVERAGE  0.67 

STD  DEV  1.13 

MIN  NUMBR  -3 

MAX  NUMBR  3 


-0.79 

1.47 

-3 

3 


0.77 

1.19 

-3 


3 


0.07 

1.30 

-3 

3 
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APPENDIX  C 


Part  A:  Proximity  Matrix  for  NH  Charleston 


U-D«e-?S  S»’SS  >»E.EASe  4.1  lEM  VM/C»tS 

!2:0*sS9  N«v»1  5'hoel  AMOArt.  S*t0-500  VH/XA  2.1 

. . 


P«f«  2 


Dal*  lAl«r«A^lftA 

101  unwPlshUd  e»i*«  •«c«Pt»d. 

0  easts  ftlteltd  btr^use  of  mlsslns  value. 
Absolut#  Euclldtsn  Atasurt  us#0. 


Absolute  Cuelldesn  OlsslAilarity  Cee44leUot  Hetrly 


Variable 

bccMto 

CHQtVS 

TONQ 

UMDCnOTD 

PART  1C 

M1DA71 

PELVINPO 

RCLVtNFO 

CH53VS 

30.7001 

TItNO 

22,0030 

22.2030 

WCEWIO 

10.9005 

20.0400 

10.5070 

pAunc 

10  .5405 

25.7245 

21.1120 

15.7949 

mid*  ft 

10. 3003 

J2.7374 

22.9074 

20.7003 

10.55:0 

REUVINFO 

19.5700 

22.1529 

19.9511 

21.5000 

H.  7055 

19.9075 

15.0570 

RELVIMPO 

10.9109 

24.245$ 

19.9311 

19.8935 

10. 0220 

I7.COOO 

15.2725 

ACCINFO 

10.3439 

20.2593 

21.5424 

20.2731 

17. .2099 

10.5270 

!3:OP03 

mciNFo 

20.0337 

21.0772 

17.4427 

18.5945 

10.1521 

2*  5174 

13.4104 

10.2942 

HIOCOHH 

9.0030 

29.5400 

20.1990 

17.9722 

17.9513 

8.9503 

19.2078 

15.9295 

TIKEDEV 

27.0402 

20.0709 

22.9450 

25.2587 

25.3720 

28.35» 

21.9943 

20.5487 

coMTtrrE 

19.0723 

21.4120 

18.5358 

21.0594 

10.1728 

21.3951 

12.7709 

11.0297 

Variable 

ACC INFO 

PRECINFO 

MIOCOHM 

TIMEDEV 

ruccuro 

14.0200 

MIOCOMM 

17.3701 

19.5584 

71MCDEV 

24.0728 

.21.0252 

25.4007 

COUPLE rE 

10.2430 

15.7005 

19,3049 

18.5558 

Tl«e  sta*»  on  saved  flle»  lO-OEC-95  12tO<*S^ 

Flit  eonUlni  IS  Y«rlrtH$.  120  b¥l«*  Ptr  etse  *f»»r. 


Part  B:  Proximity  Matrix  for  NH  Camp  Lejeune 


srs5  retEA5f  <.\  fcm  iFM  vM/ct^ 

Mav^l  5®«A-5(»p 


VM/va  2-1 


rftoxiHiric 


Faff 


Data  Inforoiatlon 

121  unwflfhttd  easfs  fcctptcd. 

0  cates  r*)tcted  because  of  atlsslnf  ualwe. 

Absolute  CuclSdean  measure  used. 


Absolute  euclidean  Dissimilarity  Coefficient  Matrix 


Variable 

PELMIO 

0»GCY5 

TPtIC 

iJNCtPSID 

PAPJ  tC 

MIDAn 

RELviwro 

RELVINFQ 

ewe^.YS 

22. <319 

TPf^S 

rc.ssis 

20.55‘i9 

U»fDCPSTD 

22.95<S 

25.3;ro 

21.1009 

PAPTIC 

17.192* 

19.2224 

180159 

14.0079 

MIPATT 

12.17M 

25.0499 

24.3$U 

24.4494 

19. 9975 

RCLVINPO 

15.8«« 

21. 2720 

21.2485 

25.5519 

17.4049 

15.5784 

PCLVIUPO 

15.41«1 

20.9404 

21.8405 

21.4747 

15.4844 

14.7182 

15.8744 

ACC INFO 

IS.SOOO 

2S.1301 

22.9545 

25.5000 

18.0851 

15.4919 

11.5542 

15.8022 

PPECIIP^O 

lO.lSlS 

20.7244 

21.9517 

22.7980 

18.0555 

18.5472 

13.5978 

14.1710 

MIDCONH 

12.5599 

25,9327 

22.4144 

25.4147 

i9.:5:o 

12.5495 

14.0448 

17.4210 

TlMEteV 

24.0000 

14.0701 

20.5409 

20.4528 

18.4945 

24.9750 

21.2191 

21.1719 

coMPure 

U.9484 

20.0997 

20.4982 

22.4444 

17.8185 

17.1410 

14.4114 

14.8441 

Variable 

ACC INFO 

PRfCt>»FO 

HIOCOMM 

TlMCOev 

PRtClt^FO 

14.4Si« 

MIOCOMM 

15,5091 

17.5493 

1 IHEOeV 

21. 2943 

20.3777 

23.4147 

COMPLETE 

15. 2151 

14.9444 

14.5851 

18.4052 

Time  stamp  on  saved  file:  l«-Dec-93  I2:C«:1< 

Plld  contains  IS  varlsblos*  120  bvtes  per  east  btfors  eemprtsslon 


Part  C:  Proximity  Matrix  for  NH  Jacksonville 


U-Ote-»S  SP3t  nUEAn  4.1  IBH  VH/CHS 

13:09r50  Neval  School  AttOAHL  S990-SOO  VM/XA  2.1 

. . . . . 


Past 


Data  Inforiaaljcn 


lit  unw9lsht94  catfs  acctattd. 

0  easct  rajtcttd  becaute  of  olssins  valua. 

Absoluts  Cuclldaan  mtasurt  usad. 


Absoluts  Cuclldoan  Dlsslul lar 1 ty  CosfftetOAt  Matrix 


Variabla 

ItCLHIO 

CII63YS 

TRtiO 

UNCERSTD 

PARTIC 

HXPATT 

RELYltiTO 

KELVIfTO 

C»*0SYS 

29.4!«< 

TRtIO 

2S.S8!? 

18.8414 

UNOCRSTO 

^•.•ro9 

28.501? 

21.7141 

PARTIC 

18.9145 

::.942< 

18.323$ 

17.1391 

HIOATT 

14.2<S5 

:<.5?89 

22.95<$ 

18.0495 

18.(212 

REUYINFO 

15.S4dO 

28.8551 

25.1<9< 

20.4882 

!9.42r9 

14.7481 

ftCLVINFO 

1E.94S2 

27.4084 

24.479* 

20.1184 

19.2743 

14.9041 

14.4031 

Accttro 

14.9499 

29.7405 

24.5801 

21.3073 

20.5730 

14.3248 

13.1909 

13.7384 

PRECINPO 

n.5S54 

28. <313 

23.5008 

19.0853 

18.5548 

15.5945 

12.4590 

13.0000 

HIOCOMM 

14,1774 

24.8294 

21.1049 

17.7482 

17-5570 

11.0905 

14.4772 

17.5578 

TIMEOev 

24.S5S4 

17.5499 

l♦.tl2S 

24.2250 

21.3344 

25.9904 

25.9422 

24.2442 

COMPLETE 

2<.495l 

25.«4«2 

21.2152 

19.9437 

19.5520 

14.7102 

14.8913 

Variabla 

AceiNpo 

fRECINTS 

HlDCOf^l 

TIMEOEV 

PRCCIMPO 

IS. <107 

MIDCOHM 

U.8<71 

15-4553 

Tir«rEV 

25.4710 

25.9«3 

rS.47<9 

COtTLETE 

IS. 4758 

17.0075 

18.4797 

22.3407 

Tiaa  staioR  an 

stvad  flit; 

1<-DCC'95  12:08 

:50 

Flla  caatalns 

15  yarlablasi 

.  120  bvtas  Ptr 

caiaRrassSoA 
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Part  D 


Proximity  Matrix  for  Combined  Hospital  Data 


t 


:7-D<c->S  SPSS  release  «.l  FOR  IW  VM/CM5  '’•i*  * 

2|!51;20  N«v<t  Festsrtduitt  School  AMDAHL  SFSO-SOS  VM/XA2.I 

. .  .....PROXIMITIES"*"'*""*""" . . . 


D»t«  !nfor«i«tt9n 

S<0  ur«w*l9bt«d  e«s«« 

0  c»sts  r«5tettd  bae»‘Jtc  ralssSns  walut. 
Absolutt  Euclidean  Mtdsura  us«d. 


Absolut*  Euelidtoo  Dlssinllorltv  Ceofflclont  MotrlN 

Vorloblt 

RELHIC 

CMCSVS 

TRNG 

UMDERSTD 

PARTIC 

HIDATT 

RELVINFO 

RELVINFO 

CHGSVS 

4a.i7di 

tRNG 

A0.95A2 

55.4441 

UNKRSTO 

S5.277S 

45.0085 

34.4855 

PARTIC 

51.5713 

40.0562 

S5.3SSS 

50.0541 

HIDATT 

2I.<3S9 

49.0488 

Ao.ssss 

54.7947 

55.0114 

RELVIHFO 

29.5CA2 

42.1594 

58.5000 

58.0000 

50.9718 

50.2757 

RCLVINFO 

27.8971 

42.1404 

58.5842 

55.5211 

50.0093 

29.2274 

24.0052 

ACetNFO 

28.2597 

45.9129 

41.0*74 

57.4444 

52.5905 

29.1505 

21.8804 

24.7487 

RRCCINPO 

50.4309 

41.1521 

ss.siit 

35.0478 

51.5199 

32.4075 

3J.7SS0 

24.5818 

KlOCOHII 

21.0C40 

45.5597 

24.9459 

24.5794 

51.7017 

18.9415 

50.0042 

29.5591 

TIHEPCV 

44.7<S7 

51.1528 

54.4845 

41.7552 

54.4504 

45.9474 

40.0874 

58.2001 

COMPLETE 

St. sots 

59.5558 

SS.CIS7 

ss.STn 

S2.5S« 

53.4712 

ES.SIT* 

24.0414 

V«rlo61< 

ACCINPO 

PRECINFO 

MIOCQMM 

TIMEteV 

PRECINPO 

24.5105 

MtDCOMM 

28 . 7?  74 

50.5480 

TlffEDEV 

42.1589 

59.5495 

41.8838 

COMPLETE 

27. KOI 

27.5481 

51.4881 

54.5859 

Tine  steno  on 

9«etd  file: 

27-rEC-9S  21:51 

;20 

File  edntdlns 

15  vorlfbles 

>  120  bytes  pff 

e«s«  bcfd*’e 

cenrresslen 
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